[==========] Running 7 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260807 13:37:24.721251 21780 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.21.69.62:40701
I20260807 13:37:24.723484 21780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:37:24.724923 21780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:37:24.753875 21791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:37:24.753965 21792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:37:24.757164 21780 server_base.cc:1034] running on GCE node
W20260807 13:37:24.754786 21795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:37:26.037312 21780 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:37:26.037663 21780 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:37:26.037911 21780 hybrid_clock.cc:648] HybridClock initialized: now 1786109846037870 us; error 0 us; skew 500 ppm
I20260807 13:37:26.038872 21780 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:37:26.049772 21780 webserver.cc:460] Webserver started at http://127.21.69.62:36439/ using document root <none> and password file <none>
I20260807 13:37:26.051026 21780 fs_manager.cc:359] Metadata directory not provided
I20260807 13:37:26.051347 21780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:37:26.051944 21780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:37:26.059903 21780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109844500879-21780-0/minicluster-data/master-0-root/instance:
uuid: "985a55ae51484de5866293aa5c836ae0"
format_stamp: "Formatted at 2026-08-07 13:37:26 on dist-test-slave-mjjr"
I20260807 13:37:26.071914 21780 fs_manager.cc:691] Time spent creating directory manager: real 0.011s user 0.007s sys 0.004s
I20260807 13:37:26.078891 21802 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:37:26.080515 21780 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.007s sys 0.000s
I20260807 13:37:26.081003 21780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109844500879-21780-0/minicluster-data/master-0-root
uuid: "985a55ae51484de5866293aa5c836ae0"
format_stamp: "Formatted at 2026-08-07 13:37:26 on dist-test-slave-mjjr"
I20260807 13:37:26.081480 21780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109844500879-21780-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109844500879-21780-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109844500879-21780-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:37:26.128731 21780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:37:26.130597 21780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:37:26.131165 21780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:37:26.254693 21780 rpc_server.cc:307] RPC server started. Bound to: 127.21.69.62:40701
I20260807 13:37:26.254810 21875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.69.62:40701 every 8 connection(s)
I20260807 13:37:26.265659 21876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:26.297039 21876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0: Bootstrap starting.
I20260807 13:37:26.304850 21876 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:26.307349 21876 log.cc:824] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0: Log is configured to *not* fsync() on all Append() calls
I20260807 13:37:26.313686 21876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0: No bootstrap required, opened a new log
I20260807 13:37:26.343071 21876 raft_consensus.cc:348] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "985a55ae51484de5866293aa5c836ae0" member_type: VOTER }
I20260807 13:37:26.343897 21876 raft_consensus.cc:374] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:26.344188 21876 raft_consensus.cc:729] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 985a55ae51484de5866293aa5c836ae0, State: Initialized, Role: FOLLOWER
I20260807 13:37:26.345547 21876 consensus_queue.cc:260] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "985a55ae51484de5866293aa5c836ae0" member_type: VOTER }
I20260807 13:37:26.346309 21876 raft_consensus.cc:388] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 13:37:26.346666 21876 raft_consensus.cc:482] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 13:37:26.347039 21876 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:26.352823 21876 raft_consensus.cc:504] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "985a55ae51484de5866293aa5c836ae0" member_type: VOTER }
I20260807 13:37:26.353803 21876 leader_election.cc:302] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 985a55ae51484de5866293aa5c836ae0; no voters:
I20260807 13:37:26.356755 21876 leader_election.cc:288] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 13:37:26.357044 21880 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:37:26.362097 21880 raft_consensus.cc:686] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0 [term 1 LEADER]: Becoming Leader. State: Replica: 985a55ae51484de5866293aa5c836ae0, State: Running, Role: LEADER
I20260807 13:37:26.363423 21880 consensus_queue.cc:237] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "985a55ae51484de5866293aa5c836ae0" member_type: VOTER }
I20260807 13:37:26.364843 21876 sys_catalog.cc:564] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 13:37:26.382083 21883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "985a55ae51484de5866293aa5c836ae0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "985a55ae51484de5866293aa5c836ae0" member_type: VOTER } }
I20260807 13:37:26.383136 21882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 985a55ae51484de5866293aa5c836ae0. Latest consensus state: current_term: 1 leader_uuid: "985a55ae51484de5866293aa5c836ae0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "985a55ae51484de5866293aa5c836ae0" member_type: VOTER } }
I20260807 13:37:26.383487 21883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0 [sys.catalog]: This master's current role is: LEADER
I20260807 13:37:26.383786 21882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0 [sys.catalog]: This master's current role is: LEADER
I20260807 13:37:26.390254 21890 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 13:37:26.407893 21890 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 13:37:26.416371 21780 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260807 13:37:26.431854 21890 catalog_manager.cc:1347] Generated new cluster ID: 2fd0071534f341499a01bd2b846ad640
I20260807 13:37:26.432269 21890 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 13:37:26.457386 21890 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 13:37:26.459961 21890 catalog_manager.cc:1504] Loading token signing keys...
I20260807 13:37:26.478104 21890 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0: Generated new TSK 0
I20260807 13:37:26.479230 21890 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 13:37:26.548894 21780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:37:26.562011 21908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:37:26.564623 21909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:37:26.570284 21780 server_base.cc:1034] running on GCE node
W20260807 13:37:26.570423 21911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:37:26.571619 21780 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:37:26.571918 21780 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:37:26.572137 21780 hybrid_clock.cc:648] HybridClock initialized: now 1786109846572103 us; error 0 us; skew 500 ppm
I20260807 13:37:26.572795 21780 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:37:26.579820 21780 webserver.cc:460] Webserver started at http://127.21.69.1:42073/ using document root <none> and password file <none>
I20260807 13:37:26.580478 21780 fs_manager.cc:359] Metadata directory not provided
I20260807 13:37:26.580730 21780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:37:26.581032 21780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:37:26.582510 21780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109844500879-21780-0/minicluster-data/ts-0-root/instance:
uuid: "80268d1371f34a9383de934902767138"
format_stamp: "Formatted at 2026-08-07 13:37:26 on dist-test-slave-mjjr"
I20260807 13:37:26.590955 21780 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.007s sys 0.003s
I20260807 13:37:26.596944 21916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:37:26.598023 21780 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.003s
I20260807 13:37:26.598444 21780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109844500879-21780-0/minicluster-data/ts-0-root
uuid: "80268d1371f34a9383de934902767138"
format_stamp: "Formatted at 2026-08-07 13:37:26 on dist-test-slave-mjjr"
I20260807 13:37:26.598888 21780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109844500879-21780-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109844500879-21780-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109844500879-21780-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:37:26.642191 21780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:37:26.644412 21780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:37:26.648084 21780 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:37:26.654421 21780 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:37:26.654817 21780 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:37:26.655125 21780 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:37:26.655306 21780 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:37:26.824034 21780 rpc_server.cc:307] RPC server started. Bound to: 127.21.69.1:36327
I20260807 13:37:26.824150 22004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.69.1:36327 every 8 connection(s)
I20260807 13:37:26.833746 21780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:37:26.850950 22011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:37:26.854857 22012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:37:26.869977 21780 server_base.cc:1034] running on GCE node
W20260807 13:37:26.871361 22014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:37:26.872745 21780 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:37:26.873075 21780 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:37:26.873287 21780 hybrid_clock.cc:648] HybridClock initialized: now 1786109846873274 us; error 0 us; skew 500 ppm
I20260807 13:37:26.874136 21780 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:37:26.875326 22005 heartbeater.cc:347] Connected to a master server at 127.21.69.62:40701
I20260807 13:37:26.875890 22005 heartbeater.cc:464] Registering TS with master...
I20260807 13:37:26.877069 22005 heartbeater.cc:511] Master 127.21.69.62:40701 requested a full tablet report, sending...
I20260807 13:37:26.878023 21780 webserver.cc:460] Webserver started at http://127.21.69.2:39353/ using document root <none> and password file <none>
I20260807 13:37:26.878774 21780 fs_manager.cc:359] Metadata directory not provided
I20260807 13:37:26.879055 21780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:37:26.879380 21780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:37:26.881487 21825 ts_manager.cc:194] Registered new tserver with Master: 80268d1371f34a9383de934902767138 (127.21.69.1:36327)
I20260807 13:37:26.883953 21780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109844500879-21780-0/minicluster-data/ts-1-root/instance:
uuid: "e3a48abf21bc4253ab8cfa5df3234768"
format_stamp: "Formatted at 2026-08-07 13:37:26 on dist-test-slave-mjjr"
I20260807 13:37:26.886040 21825 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49012
I20260807 13:37:26.892874 21780 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260807 13:37:26.897750 22021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:37:26.898891 21780 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 13:37:26.899277 21780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109844500879-21780-0/minicluster-data/ts-1-root
uuid: "e3a48abf21bc4253ab8cfa5df3234768"
format_stamp: "Formatted at 2026-08-07 13:37:26 on dist-test-slave-mjjr"
I20260807 13:37:26.899791 21780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109844500879-21780-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109844500879-21780-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109844500879-21780-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:37:26.921713 21780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:37:26.923566 21780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:37:26.925871 21780 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:37:26.930359 21780 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:37:26.930691 21780 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:37:26.931012 21780 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:37:26.931222 21780 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:37:27.056576 21780 rpc_server.cc:307] RPC server started. Bound to: 127.21.69.2:40987
I20260807 13:37:27.057267 22104 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.69.2:40987 every 8 connection(s)
I20260807 13:37:27.065212 21780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:37:27.077757 22110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:37:27.079147 22109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:37:27.085423 22105 heartbeater.cc:347] Connected to a master server at 127.21.69.62:40701
I20260807 13:37:27.086024 22105 heartbeater.cc:464] Registering TS with master...
I20260807 13:37:27.087347 22105 heartbeater.cc:511] Master 127.21.69.62:40701 requested a full tablet report, sending...
I20260807 13:37:27.088909 21780 server_base.cc:1034] running on GCE node
W20260807 13:37:27.090128 22113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:37:27.090288 21825 ts_manager.cc:194] Registered new tserver with Master: e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987)
I20260807 13:37:27.091250 21780 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:37:27.091498 21780 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:37:27.091717 21780 hybrid_clock.cc:648] HybridClock initialized: now 1786109847091701 us; error 0 us; skew 500 ppm
I20260807 13:37:27.092303 21780 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:37:27.092937 21825 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49024
I20260807 13:37:27.096388 21780 webserver.cc:460] Webserver started at http://127.21.69.3:35087/ using document root <none> and password file <none>
I20260807 13:37:27.097126 21780 fs_manager.cc:359] Metadata directory not provided
I20260807 13:37:27.097404 21780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:37:27.097898 21780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:37:27.099383 21780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109844500879-21780-0/minicluster-data/ts-2-root/instance:
uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
format_stamp: "Formatted at 2026-08-07 13:37:27 on dist-test-slave-mjjr"
I20260807 13:37:27.105944 21780 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 13:37:27.110283 22119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:37:27.111406 21780 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 13:37:27.111860 21780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109844500879-21780-0/minicluster-data/ts-2-root
uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
format_stamp: "Formatted at 2026-08-07 13:37:27 on dist-test-slave-mjjr"
I20260807 13:37:27.112221 21780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109844500879-21780-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109844500879-21780-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109844500879-21780-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:37:27.126163 21780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:37:27.127821 21780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:37:27.130498 21780 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:37:27.134301 21780 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:37:27.134583 21780 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:37:27.134931 21780 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:37:27.135088 21780 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:37:27.265010 21780 rpc_server.cc:307] RPC server started. Bound to: 127.21.69.3:38401
I20260807 13:37:27.265430 22210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.69.3:38401 every 8 connection(s)
I20260807 13:37:27.290164 22211 heartbeater.cc:347] Connected to a master server at 127.21.69.62:40701
I20260807 13:37:27.290602 22211 heartbeater.cc:464] Registering TS with master...
I20260807 13:37:27.291816 22211 heartbeater.cc:511] Master 127.21.69.62:40701 requested a full tablet report, sending...
I20260807 13:37:27.294418 21825 ts_manager.cc:194] Registered new tserver with Master: b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:27.294981 21780 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019808814s
I20260807 13:37:27.297030 21825 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49028
I20260807 13:37:27.299822 21780 test_util.cc:268] Using random seed: 452617936
I20260807 13:37:27.368840 21825 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49040:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 13:37:27.373586 21825 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 13:37:27.514226 21953 tablet_service.cc:1467] Processing CreateTablet for tablet bdd8f5d33fb34ce6a5f5dd56f5a4846d (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260807 13:37:27.520793 21944 tablet_service.cc:1467] Processing CreateTablet for tablet 1ba53dccaae2468baf467e13e4ae3738 (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260807 13:37:27.514838 21949 tablet_service.cc:1467] Processing CreateTablet for tablet 7026bb7599934e0799edcd002a653f67 (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260807 13:37:27.521245 21941 tablet_service.cc:1467] Processing CreateTablet for tablet 01dc391e2ed6419c91dffb6033bd6abe (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260807 13:37:27.516722 21947 tablet_service.cc:1467] Processing CreateTablet for tablet 7cc45a0c9f0e4f7fb44e5cdf41d038ee (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260807 13:37:27.516947 21948 tablet_service.cc:1467] Processing CreateTablet for tablet af2dd6d4811f4b4b9586296ea6a8043e (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260807 13:37:27.518746 21946 tablet_service.cc:1467] Processing CreateTablet for tablet 2030a14e8f0447fdbcaef7c340a1cbbd (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260807 13:37:27.518951 21943 tablet_service.cc:1467] Processing CreateTablet for tablet 94c992d4337f48318c5bf5cefae9aaad (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260807 13:37:27.522993 21941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01dc391e2ed6419c91dffb6033bd6abe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.520536 21951 tablet_service.cc:1467] Processing CreateTablet for tablet 7fb75c03887d4004ba72504f437cd753 (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260807 13:37:27.528247 21944 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ba53dccaae2468baf467e13e4ae3738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.530259 22057 tablet_service.cc:1467] Processing CreateTablet for tablet bdd8f5d33fb34ce6a5f5dd56f5a4846d (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260807 13:37:27.531876 22050 tablet_service.cc:1467] Processing CreateTablet for tablet 1ba53dccaae2468baf467e13e4ae3738 (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260807 13:37:27.532510 22057 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdd8f5d33fb34ce6a5f5dd56f5a4846d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.532444 22056 tablet_service.cc:1467] Processing CreateTablet for tablet 7fb75c03887d4004ba72504f437cd753 (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260807 13:37:27.533530 22050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ba53dccaae2468baf467e13e4ae3738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.534277 21946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2030a14e8f0447fdbcaef7c340a1cbbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.535142 22055 tablet_service.cc:1467] Processing CreateTablet for tablet 7026bb7599934e0799edcd002a653f67 (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260807 13:37:27.536158 21948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af2dd6d4811f4b4b9586296ea6a8043e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.537833 21943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94c992d4337f48318c5bf5cefae9aaad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.538057 22046 tablet_service.cc:1467] Processing CreateTablet for tablet 01dc391e2ed6419c91dffb6033bd6abe (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260807 13:37:27.539471 21947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cc45a0c9f0e4f7fb44e5cdf41d038ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.540268 22055 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7026bb7599934e0799edcd002a653f67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.546237 22054 tablet_service.cc:1467] Processing CreateTablet for tablet af2dd6d4811f4b4b9586296ea6a8043e (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260807 13:37:27.549618 21951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fb75c03887d4004ba72504f437cd753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.552675 22053 tablet_service.cc:1467] Processing CreateTablet for tablet 7cc45a0c9f0e4f7fb44e5cdf41d038ee (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260807 13:37:27.559700 22049 tablet_service.cc:1467] Processing CreateTablet for tablet 94c992d4337f48318c5bf5cefae9aaad (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260807 13:37:27.563071 22046 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01dc391e2ed6419c91dffb6033bd6abe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.554011 22052 tablet_service.cc:1467] Processing CreateTablet for tablet 2030a14e8f0447fdbcaef7c340a1cbbd (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260807 13:37:27.566696 22049 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94c992d4337f48318c5bf5cefae9aaad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.573203 22052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2030a14e8f0447fdbcaef7c340a1cbbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.589365 22054 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af2dd6d4811f4b4b9586296ea6a8043e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.595077 22053 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cc45a0c9f0e4f7fb44e5cdf41d038ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.602459 22056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fb75c03887d4004ba72504f437cd753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.590730 21953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdd8f5d33fb34ce6a5f5dd56f5a4846d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.633000 21949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7026bb7599934e0799edcd002a653f67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.646602 22159 tablet_service.cc:1467] Processing CreateTablet for tablet 7fb75c03887d4004ba72504f437cd753 (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260807 13:37:27.653771 22154 tablet_service.cc:1467] Processing CreateTablet for tablet 7cc45a0c9f0e4f7fb44e5cdf41d038ee (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260807 13:37:27.661128 22154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cc45a0c9f0e4f7fb44e5cdf41d038ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.677945 22152 tablet_service.cc:1467] Processing CreateTablet for tablet 2030a14e8f0447fdbcaef7c340a1cbbd (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260807 13:37:27.684891 22159 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fb75c03887d4004ba72504f437cd753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.670804 22157 tablet_service.cc:1467] Processing CreateTablet for tablet 7026bb7599934e0799edcd002a653f67 (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260807 13:37:27.680215 22160 tablet_service.cc:1467] Processing CreateTablet for tablet bdd8f5d33fb34ce6a5f5dd56f5a4846d (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260807 13:37:27.721194 22147 tablet_service.cc:1467] Processing CreateTablet for tablet 94c992d4337f48318c5bf5cefae9aaad (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260807 13:37:27.727967 22146 tablet_service.cc:1467] Processing CreateTablet for tablet 01dc391e2ed6419c91dffb6033bd6abe (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260807 13:37:27.699782 22155 tablet_service.cc:1467] Processing CreateTablet for tablet af2dd6d4811f4b4b9586296ea6a8043e (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260807 13:37:27.736475 22152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2030a14e8f0447fdbcaef7c340a1cbbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.688181 22151 tablet_service.cc:1467] Processing CreateTablet for tablet 1ba53dccaae2468baf467e13e4ae3738 (DEFAULT_TABLE table=test-workload [id=b66e3a48ef9e40a78a57e7e3f063a6d4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260807 13:37:27.739003 22160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdd8f5d33fb34ce6a5f5dd56f5a4846d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.750332 22155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af2dd6d4811f4b4b9586296ea6a8043e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.757165 22146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01dc391e2ed6419c91dffb6033bd6abe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.789140 22147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94c992d4337f48318c5bf5cefae9aaad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.796525 22157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7026bb7599934e0799edcd002a653f67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.798635 22151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ba53dccaae2468baf467e13e4ae3738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:27.891690 22005 heartbeater.cc:503] Master 127.21.69.62:40701 was elected leader, sending a full tablet report...
I20260807 13:37:27.896575 22238 tablet_bootstrap.cc:492] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138: Bootstrap starting.
I20260807 13:37:27.950217 22240 tablet_bootstrap.cc:492] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768: Bootstrap starting.
I20260807 13:37:27.983635 22238 tablet_bootstrap.cc:654] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:27.985311 22242 tablet_bootstrap.cc:492] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f: Bootstrap starting.
I20260807 13:37:28.020527 22240 tablet_bootstrap.cc:654] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:28.026320 22242 tablet_bootstrap.cc:654] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:28.026453 22238 tablet_bootstrap.cc:492] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138: No bootstrap required, opened a new log
I20260807 13:37:28.027299 22238 ts_tablet_manager.cc:1397] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138: Time spent bootstrapping tablet: real 0.135s user 0.012s sys 0.008s
I20260807 13:37:28.032369 22238 raft_consensus.cc:348] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.033701 22238 raft_consensus.cc:374] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:28.034349 22238 raft_consensus.cc:729] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80268d1371f34a9383de934902767138, State: Initialized, Role: FOLLOWER
I20260807 13:37:28.035535 22238 consensus_queue.cc:260] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.037830 22240 tablet_bootstrap.cc:492] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768: No bootstrap required, opened a new log
I20260807 13:37:28.038507 22240 ts_tablet_manager.cc:1397] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768: Time spent bootstrapping tablet: real 0.122s user 0.008s sys 0.015s
I20260807 13:37:28.042652 22240 raft_consensus.cc:348] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.044232 22240 raft_consensus.cc:374] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:28.044548 22240 raft_consensus.cc:729] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Initialized, Role: FOLLOWER
I20260807 13:37:28.045833 22238 ts_tablet_manager.cc:1428] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138: Time spent starting tablet: real 0.018s user 0.010s sys 0.005s
I20260807 13:37:28.045425 22240 consensus_queue.cc:260] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.049032 22238 tablet_bootstrap.cc:492] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138: Bootstrap starting.
I20260807 13:37:28.049700 22242 tablet_bootstrap.cc:492] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f: No bootstrap required, opened a new log
I20260807 13:37:28.050164 22242 ts_tablet_manager.cc:1397] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f: Time spent bootstrapping tablet: real 0.066s user 0.008s sys 0.022s
I20260807 13:37:28.055450 22240 ts_tablet_manager.cc:1428] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768: Time spent starting tablet: real 0.017s user 0.000s sys 0.013s
I20260807 13:37:28.056556 22240 tablet_bootstrap.cc:492] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768: Bootstrap starting.
I20260807 13:37:28.056301 22105 heartbeater.cc:503] Master 127.21.69.62:40701 was elected leader, sending a full tablet report...
W20260807 13:37:28.067734 22106 tablet.cc:2369] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 13:37:28.069468 22242 raft_consensus.cc:348] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.075539 22242 raft_consensus.cc:374] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:28.075984 22242 raft_consensus.cc:729] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04c8a3c1c244a42a2eaf39b6cbd045f, State: Initialized, Role: FOLLOWER
I20260807 13:37:28.076810 22242 consensus_queue.cc:260] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.077714 22240 tablet_bootstrap.cc:654] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:28.085911 22242 ts_tablet_manager.cc:1428] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f: Time spent starting tablet: real 0.035s user 0.011s sys 0.006s
I20260807 13:37:28.086159 22211 heartbeater.cc:503] Master 127.21.69.62:40701 was elected leader, sending a full tablet report...
I20260807 13:37:28.087064 22242 tablet_bootstrap.cc:492] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f: Bootstrap starting.
I20260807 13:37:28.090258 22240 tablet_bootstrap.cc:492] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768: No bootstrap required, opened a new log
I20260807 13:37:28.090793 22240 ts_tablet_manager.cc:1397] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768: Time spent bootstrapping tablet: real 0.034s user 0.019s sys 0.011s
I20260807 13:37:28.095883 22240 raft_consensus.cc:348] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.096724 22240 raft_consensus.cc:374] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:28.097151 22242 tablet_bootstrap.cc:654] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:28.097065 22240 raft_consensus.cc:729] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Initialized, Role: FOLLOWER
I20260807 13:37:28.099083 22240 consensus_queue.cc:260] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.101475 22238 tablet_bootstrap.cc:654] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:28.101722 22240 ts_tablet_manager.cc:1428] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20260807 13:37:28.105736 22240 tablet_bootstrap.cc:492] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768: Bootstrap starting.
I20260807 13:37:28.115407 22240 tablet_bootstrap.cc:654] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:28.123764 22238 tablet_bootstrap.cc:492] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138: No bootstrap required, opened a new log
I20260807 13:37:28.125247 22238 ts_tablet_manager.cc:1397] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138: Time spent bootstrapping tablet: real 0.076s user 0.013s sys 0.009s
I20260807 13:37:28.129292 22242 tablet_bootstrap.cc:492] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f: No bootstrap required, opened a new log
I20260807 13:37:28.129859 22242 ts_tablet_manager.cc:1397] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f: Time spent bootstrapping tablet: real 0.043s user 0.019s sys 0.010s
I20260807 13:37:28.129525 22238 raft_consensus.cc:348] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.144574 22238 raft_consensus.cc:374] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:28.144941 22238 raft_consensus.cc:729] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80268d1371f34a9383de934902767138, State: Initialized, Role: FOLLOWER
I20260807 13:37:28.138980 22242 raft_consensus.cc:348] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.145658 22238 consensus_queue.cc:260] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.146904 22242 raft_consensus.cc:374] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:28.149787 22238 ts_tablet_manager.cc:1428] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138: Time spent starting tablet: real 0.024s user 0.006s sys 0.001s
I20260807 13:37:28.147342 22242 raft_consensus.cc:729] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04c8a3c1c244a42a2eaf39b6cbd045f, State: Initialized, Role: FOLLOWER
I20260807 13:37:28.150609 22240 tablet_bootstrap.cc:492] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768: No bootstrap required, opened a new log
I20260807 13:37:28.151170 22240 ts_tablet_manager.cc:1397] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768: Time spent bootstrapping tablet: real 0.046s user 0.018s sys 0.018s
I20260807 13:37:28.150837 22242 consensus_queue.cc:260] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.154207 22238 tablet_bootstrap.cc:492] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138: Bootstrap starting.
I20260807 13:37:28.156301 22240 raft_consensus.cc:348] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.157228 22240 raft_consensus.cc:374] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:28.157596 22240 raft_consensus.cc:729] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Initialized, Role: FOLLOWER
I20260807 13:37:28.158519 22240 consensus_queue.cc:260] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.161550 22238 tablet_bootstrap.cc:654] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:28.162961 22240 ts_tablet_manager.cc:1428] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768: Time spent starting tablet: real 0.011s user 0.006s sys 0.002s
I20260807 13:37:28.164243 22240 tablet_bootstrap.cc:492] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768: Bootstrap starting.
I20260807 13:37:28.171617 22240 tablet_bootstrap.cc:654] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:28.178659 22238 tablet_bootstrap.cc:492] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138: No bootstrap required, opened a new log
I20260807 13:37:28.179318 22238 ts_tablet_manager.cc:1397] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138: Time spent bootstrapping tablet: real 0.025s user 0.009s sys 0.008s
I20260807 13:37:28.182266 22242 ts_tablet_manager.cc:1428] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f: Time spent starting tablet: real 0.052s user 0.011s sys 0.000s
I20260807 13:37:28.183662 22242 tablet_bootstrap.cc:492] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f: Bootstrap starting.
I20260807 13:37:28.185314 22240 tablet_bootstrap.cc:492] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768: No bootstrap required, opened a new log
I20260807 13:37:28.185925 22240 ts_tablet_manager.cc:1397] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768: Time spent bootstrapping tablet: real 0.022s user 0.012s sys 0.007s
I20260807 13:37:28.186046 22238 raft_consensus.cc:348] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.186954 22238 raft_consensus.cc:374] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:28.187274 22238 raft_consensus.cc:729] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80268d1371f34a9383de934902767138, State: Initialized, Role: FOLLOWER
I20260807 13:37:28.188040 22238 consensus_queue.cc:260] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.189884 22240 raft_consensus.cc:348] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.190856 22240 raft_consensus.cc:374] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:28.191255 22240 raft_consensus.cc:729] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Initialized, Role: FOLLOWER
I20260807 13:37:28.191859 22238 ts_tablet_manager.cc:1428] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138: Time spent starting tablet: real 0.012s user 0.007s sys 0.001s
I20260807 13:37:28.192674 22240 consensus_queue.cc:260] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.198128 22238 tablet_bootstrap.cc:492] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138: Bootstrap starting.
I20260807 13:37:28.200402 22240 ts_tablet_manager.cc:1428] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
I20260807 13:37:28.202174 22240 tablet_bootstrap.cc:492] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768: Bootstrap starting.
I20260807 13:37:28.206979 22242 tablet_bootstrap.cc:654] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:28.210114 22240 tablet_bootstrap.cc:654] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:28.211881 22238 tablet_bootstrap.cc:654] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:28.224196 22240 tablet_bootstrap.cc:492] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768: No bootstrap required, opened a new log
I20260807 13:37:28.224694 22240 ts_tablet_manager.cc:1397] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768: Time spent bootstrapping tablet: real 0.023s user 0.013s sys 0.006s
I20260807 13:37:28.228696 22242 tablet_bootstrap.cc:492] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f: No bootstrap required, opened a new log
I20260807 13:37:28.228472 22240 raft_consensus.cc:348] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.229265 22242 ts_tablet_manager.cc:1397] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f: Time spent bootstrapping tablet: real 0.046s user 0.019s sys 0.001s
I20260807 13:37:28.229354 22240 raft_consensus.cc:374] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:28.229782 22240 raft_consensus.cc:729] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Initialized, Role: FOLLOWER
I20260807 13:37:28.230495 22240 consensus_queue.cc:260] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.232781 22240 ts_tablet_manager.cc:1428] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260807 13:37:28.233219 22242 raft_consensus.cc:348] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.233958 22240 tablet_bootstrap.cc:492] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768: Bootstrap starting.
I20260807 13:37:28.234105 22242 raft_consensus.cc:374] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:28.234468 22242 raft_consensus.cc:729] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04c8a3c1c244a42a2eaf39b6cbd045f, State: Initialized, Role: FOLLOWER
I20260807 13:37:28.236861 22238 tablet_bootstrap.cc:492] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138: No bootstrap required, opened a new log
I20260807 13:37:28.237360 22238 ts_tablet_manager.cc:1397] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138: Time spent bootstrapping tablet: real 0.039s user 0.006s sys 0.008s
I20260807 13:37:28.239423 22249 raft_consensus.cc:482] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:28.239989 22249 raft_consensus.cc:504] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.240734 22242 consensus_queue.cc:260] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.242283 22247 raft_consensus.cc:482] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:28.244270 22238 raft_consensus.cc:348] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.243197 22247 raft_consensus.cc:504] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.245146 22238 raft_consensus.cc:374] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:28.245492 22238 raft_consensus.cc:729] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80268d1371f34a9383de934902767138, State: Initialized, Role: FOLLOWER
I20260807 13:37:28.246212 22238 consensus_queue.cc:260] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.248081 22242 ts_tablet_manager.cc:1428] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f: Time spent starting tablet: real 0.018s user 0.004s sys 0.005s
I20260807 13:37:28.248541 22247 leader_election.cc:288] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:28.251052 22242 tablet_bootstrap.cc:492] T 2030a14e8f0447fdbcaef7c340a1cbbd P b04c8a3c1c244a42a2eaf39b6cbd045f: Bootstrap starting.
I20260807 13:37:28.259963 22240 tablet_bootstrap.cc:654] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:28.266619 22249 leader_election.cc:288] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:28.273882 22249 raft_consensus.cc:482] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:28.274669 22249 raft_consensus.cc:504] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.282205 22263 raft_consensus.cc:482] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:28.282991 22263 raft_consensus.cc:504] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.285935 22263 leader_election.cc:288] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:28.300570 22242 tablet_bootstrap.cc:654] T 2030a14e8f0447fdbcaef7c340a1cbbd P b04c8a3c1c244a42a2eaf39b6cbd045f: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:28.304772 22249 leader_election.cc:288] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:28.333391 22250 raft_consensus.cc:482] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:28.333964 22238 ts_tablet_manager.cc:1428] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138: Time spent starting tablet: real 0.096s user 0.013s sys 0.007s
I20260807 13:37:28.334200 22250 raft_consensus.cc:504] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.337702 22238 tablet_bootstrap.cc:492] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138: Bootstrap starting.
I20260807 13:37:28.346148 22250 leader_election.cc:288] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987)
I20260807 13:37:28.365072 22242 tablet_bootstrap.cc:492] T 2030a14e8f0447fdbcaef7c340a1cbbd P b04c8a3c1c244a42a2eaf39b6cbd045f: No bootstrap required, opened a new log
I20260807 13:37:28.365967 22242 ts_tablet_manager.cc:1397] T 2030a14e8f0447fdbcaef7c340a1cbbd P b04c8a3c1c244a42a2eaf39b6cbd045f: Time spent bootstrapping tablet: real 0.117s user 0.013s sys 0.011s
I20260807 13:37:28.385963 22269 raft_consensus.cc:482] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:28.386695 22269 raft_consensus.cc:504] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.392462 22242 raft_consensus.cc:348] T 2030a14e8f0447fdbcaef7c340a1cbbd P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.395704 22242 raft_consensus.cc:374] T 2030a14e8f0447fdbcaef7c340a1cbbd P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:28.396664 22242 raft_consensus.cc:729] T 2030a14e8f0447fdbcaef7c340a1cbbd P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04c8a3c1c244a42a2eaf39b6cbd045f, State: Initialized, Role: FOLLOWER
I20260807 13:37:28.390193 22269 leader_election.cc:288] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
W20260807 13:37:28.399956 21892 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:37:28.397969 22242 consensus_queue.cc:260] T 2030a14e8f0447fdbcaef7c340a1cbbd P b04c8a3c1c244a42a2eaf39b6cbd045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.403441 22242 ts_tablet_manager.cc:1428] T 2030a14e8f0447fdbcaef7c340a1cbbd P b04c8a3c1c244a42a2eaf39b6cbd045f: Time spent starting tablet: real 0.037s user 0.008s sys 0.003s
I20260807 13:37:28.415992 22242 tablet_bootstrap.cc:492] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f: Bootstrap starting.
I20260807 13:37:28.426801 22250 raft_consensus.cc:482] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:28.428162 22250 raft_consensus.cc:504] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.426790 22265 raft_consensus.cc:482] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:28.434368 22240 tablet_bootstrap.cc:492] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768: No bootstrap required, opened a new log
I20260807 13:37:28.438769 22269 raft_consensus.cc:482] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:28.439692 22269 raft_consensus.cc:504] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.440987 22238 tablet_bootstrap.cc:654] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:28.451824 22240 ts_tablet_manager.cc:1397] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768: Time spent bootstrapping tablet: real 0.209s user 0.014s sys 0.018s
I20260807 13:37:28.469760 22242 tablet_bootstrap.cc:654] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:28.469383 22170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb75c03887d4004ba72504f437cd753" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" is_pre_election: true
I20260807 13:37:28.476740 22174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dc391e2ed6419c91dffb6033bd6abe" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" is_pre_election: true
I20260807 13:37:28.479202 22174 raft_consensus.cc:2454] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a48abf21bc4253ab8cfa5df3234768 in term 0.
I20260807 13:37:28.475628 22172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba53dccaae2468baf467e13e4ae3738" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" is_pre_election: true
I20260807 13:37:28.436265 22265 raft_consensus.cc:504] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.493435 22024 leader_election.cc:302] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b04c8a3c1c244a42a2eaf39b6cbd045f, e3a48abf21bc4253ab8cfa5df3234768; no voters:
I20260807 13:37:28.495885 22249 raft_consensus.cc:2781] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:37:28.496394 22249 raft_consensus.cc:482] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:37:28.496833 22249 raft_consensus.cc:3037] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:37:28.495229 22024 leader_election.cc:341] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:28.510362 22172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba53dccaae2468baf467e13e4ae3738" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" is_pre_election: true
W20260807 13:37:28.513368 22024 leader_election.cc:341] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:28.516044 22249 raft_consensus.cc:504] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.509480 22265 leader_election.cc:288] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:28.535527 22170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af2dd6d4811f4b4b9586296ea6a8043e" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" is_pre_election: true
I20260807 13:37:28.531019 22263 raft_consensus.cc:482] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:28.532411 22172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cc45a0c9f0e4f7fb44e5cdf41d038ee" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" is_pre_election: true
W20260807 13:37:28.534693 21919 leader_election.cc:341] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:28.537350 22070 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba53dccaae2468baf467e13e4ae3738" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768" is_pre_election: true
I20260807 13:37:28.530939 22269 leader_election.cc:288] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:28.534578 22174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dc391e2ed6419c91dffb6033bd6abe" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" is_pre_election: true
I20260807 13:37:28.538841 22250 leader_election.cc:288] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987)
I20260807 13:37:28.534929 22240 raft_consensus.cc:348] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
W20260807 13:37:28.545553 21919 leader_election.cc:341] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:28.547371 22174 raft_consensus.cc:2454] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80268d1371f34a9383de934902767138 in term 0.
W20260807 13:37:28.552970 22024 leader_election.cc:341] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:28.553664 21919 leader_election.cc:302] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80268d1371f34a9383de934902767138, b04c8a3c1c244a42a2eaf39b6cbd045f; no voters:
I20260807 13:37:28.547744 22240 raft_consensus.cc:374] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:28.536712 22263 raft_consensus.cc:504] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.558339 22069 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af2dd6d4811f4b4b9586296ea6a8043e" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768" is_pre_election: true
I20260807 13:37:28.561388 22249 leader_election.cc:288] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 election: Requested vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:28.557621 22240 raft_consensus.cc:729] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Initialized, Role: FOLLOWER
I20260807 13:37:28.562160 22269 raft_consensus.cc:2781] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:37:28.549482 22070 raft_consensus.cc:2454] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80268d1371f34a9383de934902767138 in term 0.
I20260807 13:37:28.563370 22269 raft_consensus.cc:482] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:37:28.563532 22242 tablet_bootstrap.cc:492] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f: No bootstrap required, opened a new log
I20260807 13:37:28.562294 22172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dc391e2ed6419c91dffb6033bd6abe" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
I20260807 13:37:28.565730 22242 ts_tablet_manager.cc:1397] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f: Time spent bootstrapping tablet: real 0.150s user 0.023s sys 0.009s
I20260807 13:37:28.565348 22069 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dc391e2ed6419c91dffb6033bd6abe" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768" is_pre_election: true
W20260807 13:37:28.566720 21920 leader_election.cc:341] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:28.565085 22269 raft_consensus.cc:3037] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:28.567694 21920 leader_election.cc:302] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80268d1371f34a9383de934902767138; no voters: b04c8a3c1c244a42a2eaf39b6cbd045f, e3a48abf21bc4253ab8cfa5df3234768
I20260807 13:37:28.571309 22069 raft_consensus.cc:2379] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80268d1371f34a9383de934902767138 in current term 1: Already voted for candidate e3a48abf21bc4253ab8cfa5df3234768 in this term.
I20260807 13:37:28.564796 22240 consensus_queue.cc:260] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.568594 22172 raft_consensus.cc:3037] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:28.571981 22247 raft_consensus.cc:2726] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:37:28.573930 21920 leader_election.cc:302] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80268d1371f34a9383de934902767138, e3a48abf21bc4253ab8cfa5df3234768; no voters: b04c8a3c1c244a42a2eaf39b6cbd045f
I20260807 13:37:28.577172 22240 ts_tablet_manager.cc:1428] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768: Time spent starting tablet: real 0.121s user 0.018s sys 0.008s
I20260807 13:37:28.577507 22247 raft_consensus.cc:2781] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:37:28.577858 22247 raft_consensus.cc:482] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:37:28.578154 22240 tablet_bootstrap.cc:492] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768: Bootstrap starting.
I20260807 13:37:28.578192 22247 raft_consensus.cc:3037] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:28.579985 22263 leader_election.cc:288] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:28.591845 22174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2030a14e8f0447fdbcaef7c340a1cbbd" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" is_pre_election: true
I20260807 13:37:28.592595 22174 raft_consensus.cc:2454] T 2030a14e8f0447fdbcaef7c340a1cbbd P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a48abf21bc4253ab8cfa5df3234768 in term 0.
I20260807 13:37:28.592826 22247 raft_consensus.cc:504] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.593899 22024 leader_election.cc:302] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b04c8a3c1c244a42a2eaf39b6cbd045f, e3a48abf21bc4253ab8cfa5df3234768; no voters:
I20260807 13:37:28.596127 22247 leader_election.cc:288] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 election: Requested vote from peers e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:28.597576 22242 raft_consensus.cc:348] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.598297 22238 tablet_bootstrap.cc:492] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138: No bootstrap required, opened a new log
I20260807 13:37:28.598459 22242 raft_consensus.cc:374] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:28.598816 22238 ts_tablet_manager.cc:1397] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138: Time spent bootstrapping tablet: real 0.261s user 0.021s sys 0.023s
I20260807 13:37:28.598515 22174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba53dccaae2468baf467e13e4ae3738" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
I20260807 13:37:28.599083 22242 raft_consensus.cc:729] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04c8a3c1c244a42a2eaf39b6cbd045f, State: Initialized, Role: FOLLOWER
W20260807 13:37:28.600246 21919 leader_election.cc:341] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:28.600082 22242 consensus_queue.cc:260] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.596607 22263 raft_consensus.cc:2781] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:37:28.601503 22263 raft_consensus.cc:482] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:37:28.602128 22263 raft_consensus.cc:3037] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:28.602815 22238 raft_consensus.cc:348] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.604996 22069 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba53dccaae2468baf467e13e4ae3738" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
I20260807 13:37:28.605654 22069 raft_consensus.cc:3037] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:28.603554 22242 ts_tablet_manager.cc:1428] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f: Time spent starting tablet: real 0.036s user 0.007s sys 0.000s
I20260807 13:37:28.604627 22238 raft_consensus.cc:374] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:28.610929 22242 tablet_bootstrap.cc:492] T af2dd6d4811f4b4b9586296ea6a8043e P b04c8a3c1c244a42a2eaf39b6cbd045f: Bootstrap starting.
I20260807 13:37:28.609767 22238 raft_consensus.cc:729] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80268d1371f34a9383de934902767138, State: Initialized, Role: FOLLOWER
I20260807 13:37:28.613263 22238 consensus_queue.cc:260] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.614737 22250 raft_consensus.cc:482] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:28.615756 22250 raft_consensus.cc:504] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.616655 22238 ts_tablet_manager.cc:1428] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138: Time spent starting tablet: real 0.017s user 0.008s sys 0.002s
I20260807 13:37:28.619158 22238 tablet_bootstrap.cc:492] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138: Bootstrap starting.
I20260807 13:37:28.619673 22250 leader_election.cc:288] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987)
I20260807 13:37:28.625414 22247 raft_consensus.cc:482] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:28.630846 22070 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dc391e2ed6419c91dffb6033bd6abe" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768" is_pre_election: true
I20260807 13:37:28.630580 22247 raft_consensus.cc:504] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.633814 22070 raft_consensus.cc:2379] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b04c8a3c1c244a42a2eaf39b6cbd045f in current term 1: Already voted for candidate e3a48abf21bc4253ab8cfa5df3234768 in this term.
I20260807 13:37:28.635227 22066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7026bb7599934e0799edcd002a653f67" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768" is_pre_election: true
W20260807 13:37:28.637686 22124 leader_election.cc:341] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:28.637771 22269 raft_consensus.cc:504] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.639317 22068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdd8f5d33fb34ce6a5f5dd56f5a4846d" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768" is_pre_election: true
I20260807 13:37:28.641440 22247 leader_election.cc:288] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:28.642692 22174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94c992d4337f48318c5bf5cefae9aaad" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" is_pre_election: true
I20260807 13:37:28.642992 22068 raft_consensus.cc:2454] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b04c8a3c1c244a42a2eaf39b6cbd045f in term 0.
I20260807 13:37:28.644037 22066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94c992d4337f48318c5bf5cefae9aaad" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768" is_pre_election: true
I20260807 13:37:28.644906 22269 leader_election.cc:288] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 election: Requested vote from peers e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
W20260807 13:37:28.645390 21920 leader_election.cc:341] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:28.646390 22066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dc391e2ed6419c91dffb6033bd6abe" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
I20260807 13:37:28.647595 22066 raft_consensus.cc:2379] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 80268d1371f34a9383de934902767138 in current term 1: Already voted for candidate e3a48abf21bc4253ab8cfa5df3234768 in this term.
W20260807 13:37:28.647958 21919 leader_election.cc:341] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:28.649739 22124 leader_election.cc:302] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b04c8a3c1c244a42a2eaf39b6cbd045f, e3a48abf21bc4253ab8cfa5df3234768; no voters:
I20260807 13:37:28.649581 21919 leader_election.cc:302] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80268d1371f34a9383de934902767138; no voters: b04c8a3c1c244a42a2eaf39b6cbd045f, e3a48abf21bc4253ab8cfa5df3234768
I20260807 13:37:28.650092 22238 tablet_bootstrap.cc:654] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:28.650558 22250 raft_consensus.cc:2781] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:37:28.650723 22174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dc391e2ed6419c91dffb6033bd6abe" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
I20260807 13:37:28.650942 22250 raft_consensus.cc:482] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:37:28.652314 22250 raft_consensus.cc:3037] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:28.651290 22240 tablet_bootstrap.cc:654] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:28.656373 21919 leader_election.cc:302] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80268d1371f34a9383de934902767138; no voters: b04c8a3c1c244a42a2eaf39b6cbd045f, e3a48abf21bc4253ab8cfa5df3234768
I20260807 13:37:28.652462 22269 raft_consensus.cc:2726] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:37:28.660645 22247 raft_consensus.cc:2726] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:37:28.664170 21965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dc391e2ed6419c91dffb6033bd6abe" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80268d1371f34a9383de934902767138" is_pre_election: true
I20260807 13:37:28.664821 22242 tablet_bootstrap.cc:654] T af2dd6d4811f4b4b9586296ea6a8043e P b04c8a3c1c244a42a2eaf39b6cbd045f: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:28.666158 22069 raft_consensus.cc:2454] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80268d1371f34a9383de934902767138 in term 1.
I20260807 13:37:28.667399 21964 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdd8f5d33fb34ce6a5f5dd56f5a4846d" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80268d1371f34a9383de934902767138" is_pre_election: true
I20260807 13:37:28.666072 22172 raft_consensus.cc:2454] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a48abf21bc4253ab8cfa5df3234768 in term 1.
I20260807 13:37:28.667879 21963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7026bb7599934e0799edcd002a653f67" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80268d1371f34a9383de934902767138" is_pre_election: true
I20260807 13:37:28.670493 21920 leader_election.cc:302] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80268d1371f34a9383de934902767138, e3a48abf21bc4253ab8cfa5df3234768; no voters: b04c8a3c1c244a42a2eaf39b6cbd045f
I20260807 13:37:28.671466 21965 raft_consensus.cc:2379] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b04c8a3c1c244a42a2eaf39b6cbd045f in current term 1: Already voted for candidate 80268d1371f34a9383de934902767138 in this term.
I20260807 13:37:28.671866 21963 raft_consensus.cc:2454] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b04c8a3c1c244a42a2eaf39b6cbd045f in term 0.
I20260807 13:37:28.673026 22024 leader_election.cc:302] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b04c8a3c1c244a42a2eaf39b6cbd045f, e3a48abf21bc4253ab8cfa5df3234768; no voters:
I20260807 13:37:28.674914 22249 raft_consensus.cc:2781] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:37:28.674351 22269 raft_consensus.cc:2781] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:37:28.677495 21960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba53dccaae2468baf467e13e4ae3738" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80268d1371f34a9383de934902767138" is_pre_election: true
I20260807 13:37:28.677724 22249 raft_consensus.cc:686] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [term 1 LEADER]: Becoming Leader. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Running, Role: LEADER
I20260807 13:37:28.678467 22269 raft_consensus.cc:686] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [term 1 LEADER]: Becoming Leader. State: Replica: 80268d1371f34a9383de934902767138, State: Running, Role: LEADER
I20260807 13:37:28.680375 22249 consensus_queue.cc:237] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.673872 21965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb75c03887d4004ba72504f437cd753" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80268d1371f34a9383de934902767138" is_pre_election: true
I20260807 13:37:28.677330 22121 leader_election.cc:302] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80268d1371f34a9383de934902767138, b04c8a3c1c244a42a2eaf39b6cbd045f; no voters: e3a48abf21bc4253ab8cfa5df3234768
I20260807 13:37:28.680572 22269 consensus_queue.cc:237] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.680759 22263 raft_consensus.cc:504] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.677762 21961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dc391e2ed6419c91dffb6033bd6abe" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80268d1371f34a9383de934902767138" is_pre_election: true
I20260807 13:37:28.686556 21961 raft_consensus.cc:2379] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a48abf21bc4253ab8cfa5df3234768 in current term 1: Already voted for candidate 80268d1371f34a9383de934902767138 in this term.
I20260807 13:37:28.687191 22240 tablet_bootstrap.cc:492] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768: No bootstrap required, opened a new log
I20260807 13:37:28.687731 22240 ts_tablet_manager.cc:1397] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768: Time spent bootstrapping tablet: real 0.110s user 0.007s sys 0.013s
I20260807 13:37:28.688048 21961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2030a14e8f0447fdbcaef7c340a1cbbd" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80268d1371f34a9383de934902767138" is_pre_election: true
W20260807 13:37:28.688936 22023 leader_election.cc:341] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80268d1371f34a9383de934902767138 (127.21.69.1:36327): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:28.689628 22023 leader_election.cc:302] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a48abf21bc4253ab8cfa5df3234768; no voters: 80268d1371f34a9383de934902767138, b04c8a3c1c244a42a2eaf39b6cbd045f
I20260807 13:37:28.691073 22265 raft_consensus.cc:2726] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:37:28.684777 21963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cc45a0c9f0e4f7fb44e5cdf41d038ee" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80268d1371f34a9383de934902767138" is_pre_election: true
W20260807 13:37:28.692189 22023 leader_election.cc:341] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80268d1371f34a9383de934902767138 (127.21.69.1:36327): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:28.694271 22172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2030a14e8f0447fdbcaef7c340a1cbbd" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
I20260807 13:37:28.694940 22172 raft_consensus.cc:3037] T 2030a14e8f0447fdbcaef7c340a1cbbd P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:37:28.694731 22023 leader_election.cc:341] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80268d1371f34a9383de934902767138 (127.21.69.1:36327): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:28.695783 22023 leader_election.cc:302] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a48abf21bc4253ab8cfa5df3234768; no voters: 80268d1371f34a9383de934902767138, b04c8a3c1c244a42a2eaf39b6cbd045f
I20260807 13:37:28.696544 22265 raft_consensus.cc:2726] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:37:28.692176 22263 leader_election.cc:288] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 election: Requested vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:28.708174 22295 raft_consensus.cc:2781] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:37:28.708673 22295 raft_consensus.cc:482] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:37:28.709090 22295 raft_consensus.cc:3037] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:28.707082 21963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2030a14e8f0447fdbcaef7c340a1cbbd" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80268d1371f34a9383de934902767138"
I20260807 13:37:28.704813 21965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dc391e2ed6419c91dffb6033bd6abe" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80268d1371f34a9383de934902767138"
I20260807 13:37:28.712589 21965 raft_consensus.cc:2379] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a48abf21bc4253ab8cfa5df3234768 in current term 1: Already voted for candidate 80268d1371f34a9383de934902767138 in this term.
I20260807 13:37:28.709215 22250 raft_consensus.cc:504] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
W20260807 13:37:28.715723 22023 leader_election.cc:341] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80268d1371f34a9383de934902767138 (127.21.69.1:36327): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:28.715941 22121 leader_election.cc:302] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b04c8a3c1c244a42a2eaf39b6cbd045f; no voters: 80268d1371f34a9383de934902767138, e3a48abf21bc4253ab8cfa5df3234768
I20260807 13:37:28.717257 22242 tablet_bootstrap.cc:492] T af2dd6d4811f4b4b9586296ea6a8043e P b04c8a3c1c244a42a2eaf39b6cbd045f: No bootstrap required, opened a new log
I20260807 13:37:28.717760 22242 ts_tablet_manager.cc:1397] T af2dd6d4811f4b4b9586296ea6a8043e P b04c8a3c1c244a42a2eaf39b6cbd045f: Time spent bootstrapping tablet: real 0.107s user 0.014s sys 0.014s
I20260807 13:37:28.720152 22250 leader_election.cc:288] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 1 election: Requested vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987)
I20260807 13:37:28.720382 22069 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdd8f5d33fb34ce6a5f5dd56f5a4846d" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
I20260807 13:37:28.713366 22172 raft_consensus.cc:2454] T 2030a14e8f0447fdbcaef7c340a1cbbd P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a48abf21bc4253ab8cfa5df3234768 in term 1.
I20260807 13:37:28.721455 22069 raft_consensus.cc:3037] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:37:28.725633 22121 leader_election.cc:341] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80268d1371f34a9383de934902767138 (127.21.69.1:36327): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:28.728752 21965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdd8f5d33fb34ce6a5f5dd56f5a4846d" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80268d1371f34a9383de934902767138"
W20260807 13:37:28.730580 22121 leader_election.cc:341] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80268d1371f34a9383de934902767138 (127.21.69.1:36327): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:28.722517 22250 raft_consensus.cc:2726] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:37:28.745196 22069 raft_consensus.cc:2454] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04c8a3c1c244a42a2eaf39b6cbd045f in term 1.
I20260807 13:37:28.748980 22024 leader_election.cc:302] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b04c8a3c1c244a42a2eaf39b6cbd045f, e3a48abf21bc4253ab8cfa5df3234768; no voters: 80268d1371f34a9383de934902767138
I20260807 13:37:28.751716 22249 raft_consensus.cc:2781] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:37:28.750567 22242 raft_consensus.cc:348] T af2dd6d4811f4b4b9586296ea6a8043e P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.755012 22124 leader_election.cc:302] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b04c8a3c1c244a42a2eaf39b6cbd045f, e3a48abf21bc4253ab8cfa5df3234768; no voters: 80268d1371f34a9383de934902767138
I20260807 13:37:28.756441 22249 raft_consensus.cc:686] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768 [term 1 LEADER]: Becoming Leader. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Running, Role: LEADER
I20260807 13:37:28.756182 22242 raft_consensus.cc:374] T af2dd6d4811f4b4b9586296ea6a8043e P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:28.758080 22242 raft_consensus.cc:729] T af2dd6d4811f4b4b9586296ea6a8043e P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04c8a3c1c244a42a2eaf39b6cbd045f, State: Initialized, Role: FOLLOWER
I20260807 13:37:28.757659 22249 consensus_queue.cc:237] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.758790 22242 consensus_queue.cc:260] T af2dd6d4811f4b4b9586296ea6a8043e P b04c8a3c1c244a42a2eaf39b6cbd045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.760264 22250 raft_consensus.cc:2781] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:37:28.764349 22023 leader_election.cc:302] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a48abf21bc4253ab8cfa5df3234768; no voters: 80268d1371f34a9383de934902767138, b04c8a3c1c244a42a2eaf39b6cbd045f
I20260807 13:37:28.765429 22263 raft_consensus.cc:2726] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:37:28.765751 22242 ts_tablet_manager.cc:1428] T af2dd6d4811f4b4b9586296ea6a8043e P b04c8a3c1c244a42a2eaf39b6cbd045f: Time spent starting tablet: real 0.048s user 0.012s sys 0.000s
I20260807 13:37:28.768258 22238 tablet_bootstrap.cc:492] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138: No bootstrap required, opened a new log
I20260807 13:37:28.764266 22240 raft_consensus.cc:348] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.769464 22238 ts_tablet_manager.cc:1397] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138: Time spent bootstrapping tablet: real 0.152s user 0.017s sys 0.014s
I20260807 13:37:28.769383 22250 raft_consensus.cc:686] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 LEADER]: Becoming Leader. State: Replica: b04c8a3c1c244a42a2eaf39b6cbd045f, State: Running, Role: LEADER
I20260807 13:37:28.771209 22240 raft_consensus.cc:374] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:28.772598 22242 tablet_bootstrap.cc:492] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f: Bootstrap starting.
I20260807 13:37:28.773391 22250 consensus_queue.cc:237] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.771667 21824 catalog_manager.cc:5495] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80268d1371f34a9383de934902767138 (127.21.69.1). New cstate: current_term: 1 leader_uuid: "80268d1371f34a9383de934902767138" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:28.778447 22295 raft_consensus.cc:504] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.775599 21822 catalog_manager.cc:5495] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2). New cstate: current_term: 1 leader_uuid: "e3a48abf21bc4253ab8cfa5df3234768" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:28.781885 22238 raft_consensus.cc:348] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.782130 22069 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7026bb7599934e0799edcd002a653f67" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
I20260807 13:37:28.782752 22238 raft_consensus.cc:374] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:28.782130 21960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7026bb7599934e0799edcd002a653f67" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80268d1371f34a9383de934902767138"
I20260807 13:37:28.783167 22238 raft_consensus.cc:729] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80268d1371f34a9383de934902767138, State: Initialized, Role: FOLLOWER
I20260807 13:37:28.776786 22240 raft_consensus.cc:729] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Initialized, Role: FOLLOWER
W20260807 13:37:28.784108 22124 leader_election.cc:341] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:28.784191 22295 leader_election.cc:288] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 1 election: Requested vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987)
I20260807 13:37:28.785292 21960 raft_consensus.cc:3037] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:28.789717 22238 consensus_queue.cc:260] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.792918 22240 consensus_queue.cc:260] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.793948 22238 ts_tablet_manager.cc:1428] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138: Time spent starting tablet: real 0.022s user 0.005s sys 0.004s
I20260807 13:37:28.795461 22238 tablet_bootstrap.cc:492] T 2030a14e8f0447fdbcaef7c340a1cbbd P 80268d1371f34a9383de934902767138: Bootstrap starting.
I20260807 13:37:28.795607 22240 ts_tablet_manager.cc:1428] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768: Time spent starting tablet: real 0.108s user 0.009s sys 0.000s
I20260807 13:37:28.798885 21825 catalog_manager.cc:5495] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f reported cstate change: term changed from 0 to 1, leader changed from <none> to b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3). New cstate: current_term: 1 leader_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: HEALTHY } } }
I20260807 13:37:28.796844 22240 tablet_bootstrap.cc:492] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768: Bootstrap starting.
I20260807 13:37:28.810704 21960 raft_consensus.cc:2454] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04c8a3c1c244a42a2eaf39b6cbd045f in term 1.
I20260807 13:37:28.813616 22249 raft_consensus.cc:482] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:28.814805 22242 tablet_bootstrap.cc:654] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:28.814190 22249 raft_consensus.cc:504] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.815531 22121 leader_election.cc:302] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80268d1371f34a9383de934902767138, b04c8a3c1c244a42a2eaf39b6cbd045f; no voters: e3a48abf21bc4253ab8cfa5df3234768
I20260807 13:37:28.816735 22295 raft_consensus.cc:2781] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:37:28.817289 22295 raft_consensus.cc:686] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 LEADER]: Becoming Leader. State: Replica: b04c8a3c1c244a42a2eaf39b6cbd045f, State: Running, Role: LEADER
I20260807 13:37:28.818483 22249 leader_election.cc:288] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:28.818230 22295 consensus_queue.cc:237] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.818850 22172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94c992d4337f48318c5bf5cefae9aaad" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" is_pre_election: true
W20260807 13:37:28.820856 22024 leader_election.cc:341] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:28.822279 21960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94c992d4337f48318c5bf5cefae9aaad" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80268d1371f34a9383de934902767138" is_pre_election: true
I20260807 13:37:28.823129 21960 raft_consensus.cc:2454] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a48abf21bc4253ab8cfa5df3234768 in term 0.
I20260807 13:37:28.824455 22238 tablet_bootstrap.cc:654] T 2030a14e8f0447fdbcaef7c340a1cbbd P 80268d1371f34a9383de934902767138: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:28.825063 22023 leader_election.cc:302] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80268d1371f34a9383de934902767138, e3a48abf21bc4253ab8cfa5df3234768; no voters: b04c8a3c1c244a42a2eaf39b6cbd045f
I20260807 13:37:28.828118 22250 raft_consensus.cc:482] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:28.829097 22249 raft_consensus.cc:2781] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:37:28.829806 22249 raft_consensus.cc:482] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:37:28.829262 22250 raft_consensus.cc:504] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.830156 22249 raft_consensus.cc:3037] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:28.832540 22250 leader_election.cc:288] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987)
I20260807 13:37:28.835979 22069 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cc45a0c9f0e4f7fb44e5cdf41d038ee" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768" is_pre_election: true
I20260807 13:37:28.837211 22069 raft_consensus.cc:2454] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b04c8a3c1c244a42a2eaf39b6cbd045f in term 0.
I20260807 13:37:28.840196 22124 leader_election.cc:302] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b04c8a3c1c244a42a2eaf39b6cbd045f, e3a48abf21bc4253ab8cfa5df3234768; no voters:
I20260807 13:37:28.840945 22295 raft_consensus.cc:2781] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:37:28.841292 22295 raft_consensus.cc:482] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:37:28.841041 21960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cc45a0c9f0e4f7fb44e5cdf41d038ee" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80268d1371f34a9383de934902767138" is_pre_election: true
I20260807 13:37:28.841652 22295 raft_consensus.cc:3037] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:37:28.842868 22121 leader_election.cc:341] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80268d1371f34a9383de934902767138 (127.21.69.1:36327): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:28.846985 22295 raft_consensus.cc:504] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.850220 22240 tablet_bootstrap.cc:654] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:28.851707 22069 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cc45a0c9f0e4f7fb44e5cdf41d038ee" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
I20260807 13:37:28.851137 21960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cc45a0c9f0e4f7fb44e5cdf41d038ee" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80268d1371f34a9383de934902767138"
I20260807 13:37:28.853103 22069 raft_consensus.cc:3037] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:28.851971 22295 leader_election.cc:288] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 1 election: Requested vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987)
W20260807 13:37:28.859583 22121 leader_election.cc:341] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 80268d1371f34a9383de934902767138 (127.21.69.1:36327): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:28.852808 22249 raft_consensus.cc:504] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.864480 21960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94c992d4337f48318c5bf5cefae9aaad" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80268d1371f34a9383de934902767138"
I20260807 13:37:28.866469 21960 raft_consensus.cc:3037] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:28.868873 22069 raft_consensus.cc:2454] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04c8a3c1c244a42a2eaf39b6cbd045f in term 1.
I20260807 13:37:28.869992 22172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94c992d4337f48318c5bf5cefae9aaad" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
I20260807 13:37:28.870790 22242 tablet_bootstrap.cc:492] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f: No bootstrap required, opened a new log
I20260807 13:37:28.871893 22242 ts_tablet_manager.cc:1397] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f: Time spent bootstrapping tablet: real 0.102s user 0.006s sys 0.016s
I20260807 13:37:28.872501 22124 leader_election.cc:302] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b04c8a3c1c244a42a2eaf39b6cbd045f, e3a48abf21bc4253ab8cfa5df3234768; no voters: 80268d1371f34a9383de934902767138
W20260807 13:37:28.881632 22024 leader_election.cc:341] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:28.882534 22295 raft_consensus.cc:2781] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:37:28.883131 22295 raft_consensus.cc:686] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 LEADER]: Becoming Leader. State: Replica: b04c8a3c1c244a42a2eaf39b6cbd045f, State: Running, Role: LEADER
I20260807 13:37:28.871524 22249 leader_election.cc:288] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 election: Requested vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:28.884225 22295 consensus_queue.cc:237] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.886989 21960 raft_consensus.cc:2454] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a48abf21bc4253ab8cfa5df3234768 in term 1.
I20260807 13:37:28.888345 22023 leader_election.cc:302] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 80268d1371f34a9383de934902767138, e3a48abf21bc4253ab8cfa5df3234768; no voters: b04c8a3c1c244a42a2eaf39b6cbd045f
I20260807 13:37:28.889868 22249 raft_consensus.cc:2781] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:37:28.890714 22249 raft_consensus.cc:686] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 1 LEADER]: Becoming Leader. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Running, Role: LEADER
I20260807 13:37:28.896271 22240 tablet_bootstrap.cc:492] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768: No bootstrap required, opened a new log
I20260807 13:37:28.893585 22249 consensus_queue.cc:237] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.897815 22240 ts_tablet_manager.cc:1397] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768: Time spent bootstrapping tablet: real 0.101s user 0.012s sys 0.015s
I20260807 13:37:28.898581 22238 tablet_bootstrap.cc:492] T 2030a14e8f0447fdbcaef7c340a1cbbd P 80268d1371f34a9383de934902767138: No bootstrap required, opened a new log
I20260807 13:37:28.901790 22238 ts_tablet_manager.cc:1397] T 2030a14e8f0447fdbcaef7c340a1cbbd P 80268d1371f34a9383de934902767138: Time spent bootstrapping tablet: real 0.107s user 0.017s sys 0.009s
I20260807 13:37:28.900419 22242 raft_consensus.cc:348] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.903443 22242 raft_consensus.cc:374] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:28.903823 22242 raft_consensus.cc:729] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04c8a3c1c244a42a2eaf39b6cbd045f, State: Initialized, Role: FOLLOWER
I20260807 13:37:28.905848 22238 raft_consensus.cc:348] T 2030a14e8f0447fdbcaef7c340a1cbbd P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.907342 22238 raft_consensus.cc:374] T 2030a14e8f0447fdbcaef7c340a1cbbd P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:28.907781 22238 raft_consensus.cc:729] T 2030a14e8f0447fdbcaef7c340a1cbbd P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80268d1371f34a9383de934902767138, State: Initialized, Role: FOLLOWER
I20260807 13:37:28.905079 22242 consensus_queue.cc:260] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.908792 22238 consensus_queue.cc:260] T 2030a14e8f0447fdbcaef7c340a1cbbd P 80268d1371f34a9383de934902767138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.911075 22242 ts_tablet_manager.cc:1428] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f: Time spent starting tablet: real 0.039s user 0.009s sys 0.000s
I20260807 13:37:28.913142 22240 raft_consensus.cc:348] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.914474 22240 raft_consensus.cc:374] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:28.914894 22240 raft_consensus.cc:729] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Initialized, Role: FOLLOWER
I20260807 13:37:28.915155 22242 tablet_bootstrap.cc:492] T 1ba53dccaae2468baf467e13e4ae3738 P b04c8a3c1c244a42a2eaf39b6cbd045f: Bootstrap starting.
I20260807 13:37:28.915854 22240 consensus_queue.cc:260] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.919569 22238 ts_tablet_manager.cc:1428] T 2030a14e8f0447fdbcaef7c340a1cbbd P 80268d1371f34a9383de934902767138: Time spent starting tablet: real 0.017s user 0.010s sys 0.000s
I20260807 13:37:28.921649 22240 ts_tablet_manager.cc:1428] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768: Time spent starting tablet: real 0.018s user 0.008s sys 0.000s
I20260807 13:37:28.922847 22240 tablet_bootstrap.cc:492] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768: Bootstrap starting.
I20260807 13:37:28.921211 22238 tablet_bootstrap.cc:492] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138: Bootstrap starting.
I20260807 13:37:28.951035 22242 tablet_bootstrap.cc:654] T 1ba53dccaae2468baf467e13e4ae3738 P b04c8a3c1c244a42a2eaf39b6cbd045f: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:28.958253 22242 tablet_bootstrap.cc:492] T 1ba53dccaae2468baf467e13e4ae3738 P b04c8a3c1c244a42a2eaf39b6cbd045f: No bootstrap required, opened a new log
I20260807 13:37:28.958804 22242 ts_tablet_manager.cc:1397] T 1ba53dccaae2468baf467e13e4ae3738 P b04c8a3c1c244a42a2eaf39b6cbd045f: Time spent bootstrapping tablet: real 0.044s user 0.013s sys 0.001s
I20260807 13:37:28.958889 21822 catalog_manager.cc:5495] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2). New cstate: current_term: 1 leader_uuid: "e3a48abf21bc4253ab8cfa5df3234768" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:28.961081 22238 tablet_bootstrap.cc:654] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:28.961407 21822 catalog_manager.cc:5495] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2). New cstate: current_term: 1 leader_uuid: "e3a48abf21bc4253ab8cfa5df3234768" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:28.966148 22242 raft_consensus.cc:348] T 1ba53dccaae2468baf467e13e4ae3738 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.967150 22242 raft_consensus.cc:374] T 1ba53dccaae2468baf467e13e4ae3738 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:28.967537 22242 raft_consensus.cc:729] T 1ba53dccaae2468baf467e13e4ae3738 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04c8a3c1c244a42a2eaf39b6cbd045f, State: Initialized, Role: FOLLOWER
I20260807 13:37:28.968308 22242 consensus_queue.cc:260] T 1ba53dccaae2468baf467e13e4ae3738 P b04c8a3c1c244a42a2eaf39b6cbd045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.970378 22242 ts_tablet_manager.cc:1428] T 1ba53dccaae2468baf467e13e4ae3738 P b04c8a3c1c244a42a2eaf39b6cbd045f: Time spent starting tablet: real 0.011s user 0.008s sys 0.000s
I20260807 13:37:28.971071 22242 tablet_bootstrap.cc:492] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f: Bootstrap starting.
I20260807 13:37:28.974301 22240 tablet_bootstrap.cc:654] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:28.976195 22269 raft_consensus.cc:482] T 2030a14e8f0447fdbcaef7c340a1cbbd P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:28.976697 22269 raft_consensus.cc:504] T 2030a14e8f0447fdbcaef7c340a1cbbd P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.977241 22242 tablet_bootstrap.cc:654] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:28.978957 22269 leader_election.cc:288] T 2030a14e8f0447fdbcaef7c340a1cbbd P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:28.979044 21825 catalog_manager.cc:5495] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f reported cstate change: term changed from 0 to 1, leader changed from <none> to b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3). New cstate: current_term: 1 leader_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: HEALTHY } } }
I20260807 13:37:28.980257 22172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2030a14e8f0447fdbcaef7c340a1cbbd" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" is_pre_election: true
I20260807 13:37:28.981206 22172 raft_consensus.cc:2379] T 2030a14e8f0447fdbcaef7c340a1cbbd P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80268d1371f34a9383de934902767138 in current term 1: Already voted for candidate e3a48abf21bc4253ab8cfa5df3234768 in this term.
I20260807 13:37:28.981634 21825 catalog_manager.cc:5495] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f reported cstate change: term changed from 0 to 1, leader changed from <none> to b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3). New cstate: current_term: 1 leader_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: HEALTHY } } }
I20260807 13:37:28.982405 22069 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2030a14e8f0447fdbcaef7c340a1cbbd" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768" is_pre_election: true
I20260807 13:37:28.984305 21920 leader_election.cc:302] T 2030a14e8f0447fdbcaef7c340a1cbbd P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80268d1371f34a9383de934902767138; no voters: b04c8a3c1c244a42a2eaf39b6cbd045f, e3a48abf21bc4253ab8cfa5df3234768
I20260807 13:37:28.985471 22269 raft_consensus.cc:3037] T 2030a14e8f0447fdbcaef7c340a1cbbd P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:28.992892 22238 tablet_bootstrap.cc:492] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138: No bootstrap required, opened a new log
I20260807 13:37:28.993693 22238 ts_tablet_manager.cc:1397] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138: Time spent bootstrapping tablet: real 0.073s user 0.009s sys 0.010s
I20260807 13:37:28.997206 22238 raft_consensus.cc:348] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:28.998061 22238 raft_consensus.cc:374] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:28.998409 22238 raft_consensus.cc:729] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80268d1371f34a9383de934902767138, State: Initialized, Role: FOLLOWER
I20260807 13:37:28.992931 22269 raft_consensus.cc:2726] T 2030a14e8f0447fdbcaef7c340a1cbbd P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:37:28.999148 22238 consensus_queue.cc:260] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:29.001827 22238 ts_tablet_manager.cc:1428] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20260807 13:37:29.002924 22238 tablet_bootstrap.cc:492] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138: Bootstrap starting.
I20260807 13:37:29.011803 22242 tablet_bootstrap.cc:492] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f: No bootstrap required, opened a new log
I20260807 13:37:29.012486 22242 ts_tablet_manager.cc:1397] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f: Time spent bootstrapping tablet: real 0.042s user 0.021s sys 0.000s
I20260807 13:37:29.013080 22238 tablet_bootstrap.cc:654] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:29.014955 22242 raft_consensus.cc:348] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:29.015717 22242 raft_consensus.cc:374] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:29.016004 22242 raft_consensus.cc:729] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04c8a3c1c244a42a2eaf39b6cbd045f, State: Initialized, Role: FOLLOWER
I20260807 13:37:29.016633 22242 consensus_queue.cc:260] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:29.018733 22242 ts_tablet_manager.cc:1428] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260807 13:37:29.019836 22240 tablet_bootstrap.cc:492] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768: No bootstrap required, opened a new log
I20260807 13:37:29.020368 22240 ts_tablet_manager.cc:1397] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768: Time spent bootstrapping tablet: real 0.098s user 0.024s sys 0.019s
I20260807 13:37:29.023173 22240 raft_consensus.cc:348] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:29.024050 22240 raft_consensus.cc:374] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:29.024391 22240 raft_consensus.cc:729] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Initialized, Role: FOLLOWER
I20260807 13:37:29.025141 22240 consensus_queue.cc:260] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:29.027226 22238 tablet_bootstrap.cc:492] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138: No bootstrap required, opened a new log
I20260807 13:37:29.027565 22240 ts_tablet_manager.cc:1428] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260807 13:37:29.027741 22238 ts_tablet_manager.cc:1397] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138: Time spent bootstrapping tablet: real 0.025s user 0.014s sys 0.005s
I20260807 13:37:29.030442 22238 raft_consensus.cc:348] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:29.031252 22238 raft_consensus.cc:374] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:29.031543 22238 raft_consensus.cc:729] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80268d1371f34a9383de934902767138, State: Initialized, Role: FOLLOWER
I20260807 13:37:29.032219 22238 consensus_queue.cc:260] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:29.034376 22238 ts_tablet_manager.cc:1428] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260807 13:37:29.097216 22263 raft_consensus.cc:482] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:29.097797 22263 raft_consensus.cc:504] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:29.099511 22263 leader_election.cc:288] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:29.100742 21960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af2dd6d4811f4b4b9586296ea6a8043e" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80268d1371f34a9383de934902767138" is_pre_election: true
I20260807 13:37:29.101029 22172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af2dd6d4811f4b4b9586296ea6a8043e" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" is_pre_election: true
I20260807 13:37:29.101498 21960 raft_consensus.cc:2454] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a48abf21bc4253ab8cfa5df3234768 in term 0.
I20260807 13:37:29.101809 22172 raft_consensus.cc:2454] T af2dd6d4811f4b4b9586296ea6a8043e P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a48abf21bc4253ab8cfa5df3234768 in term 0.
I20260807 13:37:29.103367 22023 leader_election.cc:302] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80268d1371f34a9383de934902767138, e3a48abf21bc4253ab8cfa5df3234768; no voters:
I20260807 13:37:29.104400 22263 raft_consensus.cc:2781] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:37:29.104846 22263 raft_consensus.cc:482] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:37:29.105178 22263 raft_consensus.cc:3037] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:29.110467 22263 raft_consensus.cc:504] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:29.112324 22263 leader_election.cc:288] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 election: Requested vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:29.113631 21960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af2dd6d4811f4b4b9586296ea6a8043e" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80268d1371f34a9383de934902767138"
I20260807 13:37:29.113731 22172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af2dd6d4811f4b4b9586296ea6a8043e" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
I20260807 13:37:29.114498 21960 raft_consensus.cc:3037] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:29.114539 22172 raft_consensus.cc:3037] T af2dd6d4811f4b4b9586296ea6a8043e P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:29.119944 21960 raft_consensus.cc:2454] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a48abf21bc4253ab8cfa5df3234768 in term 1.
I20260807 13:37:29.121253 22023 leader_election.cc:302] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80268d1371f34a9383de934902767138, e3a48abf21bc4253ab8cfa5df3234768; no voters:
I20260807 13:37:29.122179 22263 raft_consensus.cc:2781] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:37:29.123067 22172 raft_consensus.cc:2454] T af2dd6d4811f4b4b9586296ea6a8043e P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a48abf21bc4253ab8cfa5df3234768 in term 1.
I20260807 13:37:29.123180 22263 raft_consensus.cc:686] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [term 1 LEADER]: Becoming Leader. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Running, Role: LEADER
I20260807 13:37:29.125450 22269 consensus_queue.cc:1035] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:37:29.125243 22263 consensus_queue.cc:237] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:29.132241 22269 raft_consensus.cc:482] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:29.132947 22269 raft_consensus.cc:504] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:29.135295 22269 leader_election.cc:288] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:29.136394 22066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb75c03887d4004ba72504f437cd753" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768" is_pre_election: true
I20260807 13:37:29.137154 22066 raft_consensus.cc:2454] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80268d1371f34a9383de934902767138 in term 0.
I20260807 13:37:29.137741 22172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb75c03887d4004ba72504f437cd753" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" is_pre_election: true
I20260807 13:37:29.138429 22172 raft_consensus.cc:2454] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80268d1371f34a9383de934902767138 in term 0.
I20260807 13:37:29.138464 21920 leader_election.cc:302] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80268d1371f34a9383de934902767138, e3a48abf21bc4253ab8cfa5df3234768; no voters:
I20260807 13:37:29.139412 22269 raft_consensus.cc:2781] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:37:29.139886 22269 raft_consensus.cc:482] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:37:29.140225 22269 raft_consensus.cc:3037] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:29.141649 21822 catalog_manager.cc:5495] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2). New cstate: current_term: 1 leader_uuid: "e3a48abf21bc4253ab8cfa5df3234768" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:29.149305 22269 raft_consensus.cc:504] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:29.151678 22269 leader_election.cc:288] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 election: Requested vote from peers e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:29.152596 22069 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb75c03887d4004ba72504f437cd753" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
I20260807 13:37:29.153308 22069 raft_consensus.cc:3037] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:29.154067 22172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb75c03887d4004ba72504f437cd753" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
I20260807 13:37:29.154796 22172 raft_consensus.cc:3037] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:29.162570 22263 raft_consensus.cc:482] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:29.163130 22263 raft_consensus.cc:504] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:29.166734 22263 leader_election.cc:288] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:29.166963 21960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7026bb7599934e0799edcd002a653f67" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80268d1371f34a9383de934902767138" is_pre_election: true
I20260807 13:37:29.168063 22174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7026bb7599934e0799edcd002a653f67" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" is_pre_election: true
I20260807 13:37:29.170157 21960 raft_consensus.cc:2379] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a48abf21bc4253ab8cfa5df3234768 in current term 1: Already voted for candidate b04c8a3c1c244a42a2eaf39b6cbd045f in this term.
I20260807 13:37:29.171378 22172 raft_consensus.cc:2454] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80268d1371f34a9383de934902767138 in term 1.
I20260807 13:37:29.172066 22023 leader_election.cc:302] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a48abf21bc4253ab8cfa5df3234768; no voters: 80268d1371f34a9383de934902767138, b04c8a3c1c244a42a2eaf39b6cbd045f
I20260807 13:37:29.178874 22263 raft_consensus.cc:3037] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:29.178926 21919 leader_election.cc:302] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80268d1371f34a9383de934902767138, b04c8a3c1c244a42a2eaf39b6cbd045f; no voters:
I20260807 13:37:29.175277 22069 raft_consensus.cc:2454] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80268d1371f34a9383de934902767138 in term 1.
I20260807 13:37:29.185613 22340 raft_consensus.cc:2781] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:37:29.189008 22172 raft_consensus.cc:3037] T 1ba53dccaae2468baf467e13e4ae3738 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:29.191327 22263 raft_consensus.cc:2726] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:37:29.197412 22295 raft_consensus.cc:482] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:29.198345 22295 raft_consensus.cc:504] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:29.199976 22340 raft_consensus.cc:686] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [term 1 LEADER]: Becoming Leader. State: Replica: 80268d1371f34a9383de934902767138, State: Running, Role: LEADER
I20260807 13:37:29.201236 22295 leader_election.cc:288] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987)
I20260807 13:37:29.202358 22340 consensus_queue.cc:237] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:29.203208 21960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94c992d4337f48318c5bf5cefae9aaad" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80268d1371f34a9383de934902767138" is_pre_election: true
I20260807 13:37:29.204079 21960 raft_consensus.cc:2379] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b04c8a3c1c244a42a2eaf39b6cbd045f in current term 1: Already voted for candidate e3a48abf21bc4253ab8cfa5df3234768 in this term.
I20260807 13:37:29.205030 22066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94c992d4337f48318c5bf5cefae9aaad" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768" is_pre_election: true
I20260807 13:37:29.207407 22121 leader_election.cc:302] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b04c8a3c1c244a42a2eaf39b6cbd045f; no voters: 80268d1371f34a9383de934902767138, e3a48abf21bc4253ab8cfa5df3234768
I20260807 13:37:29.208736 22295 raft_consensus.cc:3037] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:29.220436 22249 consensus_queue.cc:1035] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:37:29.224648 22343 consensus_queue.cc:1035] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:37:29.230494 22249 consensus_queue.cc:1035] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:37:29.234727 22295 raft_consensus.cc:2726] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:37:29.257169 22263 consensus_queue.cc:1035] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:37:29.261412 22250 consensus_queue.cc:1035] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:37:29.292443 21825 catalog_manager.cc:5495] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80268d1371f34a9383de934902767138 (127.21.69.1). New cstate: current_term: 1 leader_uuid: "80268d1371f34a9383de934902767138" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:29.313520 22340 raft_consensus.cc:482] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:29.314612 22340 raft_consensus.cc:504] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:29.318387 22066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cc45a0c9f0e4f7fb44e5cdf41d038ee" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768" is_pre_election: true
I20260807 13:37:29.319720 22066 raft_consensus.cc:2379] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 80268d1371f34a9383de934902767138 in current term 1: Already voted for candidate b04c8a3c1c244a42a2eaf39b6cbd045f in this term.
I20260807 13:37:29.321640 21963 raft_consensus.cc:3037] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:29.322001 22340 leader_election.cc:288] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:29.330521 22170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cc45a0c9f0e4f7fb44e5cdf41d038ee" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" is_pre_election: true
I20260807 13:37:29.330029 22249 consensus_queue.cc:1035] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260807 13:37:29.351163 21919 leader_election.cc:302] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80268d1371f34a9383de934902767138; no voters: b04c8a3c1c244a42a2eaf39b6cbd045f, e3a48abf21bc4253ab8cfa5df3234768
I20260807 13:37:29.351537 22354 consensus_queue.cc:1035] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260807 13:37:29.353669 22340 raft_consensus.cc:3037] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:29.366585 22354 consensus_queue.cc:1035] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:37:29.390662 22340 raft_consensus.cc:2726] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:37:29.392577 22263 consensus_queue.cc:1035] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:37:29.402791 22354 consensus_queue.cc:1035] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:37:29.490520 22295 consensus_queue.cc:1035] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:37:29.509850 22249 consensus_queue.cc:1035] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:37:29.515055 22295 consensus_queue.cc:1035] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260807 13:37:29.563830 22169 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bdd8f5d33fb34ce6a5f5dd56f5a4846d"
dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
mode: GRACEFUL
new_leader_uuid: "80268d1371f34a9383de934902767138"
from {username='slave'} at 127.0.0.1:35120
I20260807 13:37:29.565011 22169 raft_consensus.cc:595] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 LEADER]: Received request to transfer leadership to TS 80268d1371f34a9383de934902767138
I20260807 13:37:29.571826 22373 consensus_queue.cc:1035] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:37:29.596200 22169 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7026bb7599934e0799edcd002a653f67"
dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
mode: GRACEFUL
new_leader_uuid: "80268d1371f34a9383de934902767138"
from {username='slave'} at 127.0.0.1:35120
I20260807 13:37:29.597048 22169 raft_consensus.cc:595] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 LEADER]: Received request to transfer leadership to TS 80268d1371f34a9383de934902767138
I20260807 13:37:29.645336 22249 consensus_queue.cc:1035] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:37:29.652088 22066 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "af2dd6d4811f4b4b9586296ea6a8043e"
dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
mode: GRACEFUL
new_leader_uuid: "80268d1371f34a9383de934902767138"
from {username='slave'} at 127.0.0.1:36106
I20260807 13:37:29.652827 22066 raft_consensus.cc:595] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [term 1 LEADER]: Received request to transfer leadership to TS 80268d1371f34a9383de934902767138
I20260807 13:37:29.663558 22169 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7cc45a0c9f0e4f7fb44e5cdf41d038ee"
dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
mode: GRACEFUL
new_leader_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
from {username='slave'} at 127.0.0.1:35120
I20260807 13:37:29.664328 22169 raft_consensus.cc:595] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 LEADER]: Received request to transfer leadership to TS e3a48abf21bc4253ab8cfa5df3234768
I20260807 13:37:29.671285 22263 raft_consensus.cc:979] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768: : Instructing follower 80268d1371f34a9383de934902767138 to start an election
I20260807 13:37:29.671990 22263 raft_consensus.cc:1067] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [term 1 LEADER]: Signalling peer 80268d1371f34a9383de934902767138 to start an election
I20260807 13:37:29.674118 21965 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "af2dd6d4811f4b4b9586296ea6a8043e"
dest_uuid: "80268d1371f34a9383de934902767138"
from {username='slave'} at 127.0.0.1:49808
I20260807 13:37:29.674865 21965 raft_consensus.cc:482] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:37:29.675297 21965 raft_consensus.cc:3037] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:29.685801 21965 raft_consensus.cc:504] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:29.688906 22066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af2dd6d4811f4b4b9586296ea6a8043e" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
I20260807 13:37:29.689523 22066 raft_consensus.cc:3032] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:37:29.689929 22066 raft_consensus.cc:729] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Running, Role: LEADER
I20260807 13:37:29.690908 22170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af2dd6d4811f4b4b9586296ea6a8043e" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
I20260807 13:37:29.690889 22066 consensus_queue.cc:260] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:29.691913 22170 raft_consensus.cc:3037] T af2dd6d4811f4b4b9586296ea6a8043e P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:29.692395 22066 raft_consensus.cc:3037] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:29.697027 21960 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1ba53dccaae2468baf467e13e4ae3738"
dest_uuid: "80268d1371f34a9383de934902767138"
mode: GRACEFUL
new_leader_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
from {username='slave'} at 127.0.0.1:49816
I20260807 13:37:29.697742 21960 raft_consensus.cc:595] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [term 1 LEADER]: Received request to transfer leadership to TS e3a48abf21bc4253ab8cfa5df3234768
I20260807 13:37:29.699796 21965 leader_election.cc:288] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 2 election: Requested vote from peers e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:29.700975 22170 raft_consensus.cc:2454] T af2dd6d4811f4b4b9586296ea6a8043e P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80268d1371f34a9383de934902767138 in term 2.
I20260807 13:37:29.701962 22066 raft_consensus.cc:2454] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80268d1371f34a9383de934902767138 in term 2.
I20260807 13:37:29.702672 21919 leader_election.cc:302] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80268d1371f34a9383de934902767138, b04c8a3c1c244a42a2eaf39b6cbd045f; no voters:
I20260807 13:37:29.703733 22340 raft_consensus.cc:2781] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:37:29.704223 22340 raft_consensus.cc:686] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [term 2 LEADER]: Becoming Leader. State: Replica: 80268d1371f34a9383de934902767138, State: Running, Role: LEADER
I20260807 13:37:29.705071 22340 consensus_queue.cc:237] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:29.708621 22066 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "01dc391e2ed6419c91dffb6033bd6abe"
dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
mode: GRACEFUL
new_leader_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
from {username='slave'} at 127.0.0.1:36106
I20260807 13:37:29.709302 22066 raft_consensus.cc:595] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [term 1 LEADER]: Received request to transfer leadership to TS b04c8a3c1c244a42a2eaf39b6cbd045f
I20260807 13:37:29.713361 21825 catalog_manager.cc:5495] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 reported cstate change: term changed from 1 to 2, leader changed from e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2) to 80268d1371f34a9383de934902767138 (127.21.69.1). New cstate: current_term: 2 leader_uuid: "80268d1371f34a9383de934902767138" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:29.719552 22340 consensus_queue.cc:1035] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:37:29.733578 22340 consensus_queue.cc:1035] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:37:29.794248 22263 raft_consensus.cc:979] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768: : Instructing follower b04c8a3c1c244a42a2eaf39b6cbd045f to start an election
I20260807 13:37:29.794773 22372 raft_consensus.cc:1067] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [term 1 LEADER]: Signalling peer b04c8a3c1c244a42a2eaf39b6cbd045f to start an election
I20260807 13:37:29.797032 22170 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "01dc391e2ed6419c91dffb6033bd6abe"
dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
from {username='slave'} at 127.0.0.1:35106
I20260807 13:37:29.797627 22170 raft_consensus.cc:482] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:37:29.797971 22170 raft_consensus.cc:3037] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:29.803886 22170 raft_consensus.cc:504] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:29.806088 22170 leader_election.cc:288] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 2 election: Requested vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987)
I20260807 13:37:29.807194 21965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dc391e2ed6419c91dffb6033bd6abe" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "80268d1371f34a9383de934902767138"
I20260807 13:37:29.807570 22066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dc391e2ed6419c91dffb6033bd6abe" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
I20260807 13:37:29.807898 21965 raft_consensus.cc:3037] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:29.808254 22066 raft_consensus.cc:3032] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:37:29.808607 22066 raft_consensus.cc:729] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Running, Role: LEADER
I20260807 13:37:29.809494 22066 consensus_queue.cc:260] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:29.810817 22066 raft_consensus.cc:3037] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:29.814754 21965 raft_consensus.cc:2454] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04c8a3c1c244a42a2eaf39b6cbd045f in term 2.
I20260807 13:37:29.816228 22121 leader_election.cc:302] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80268d1371f34a9383de934902767138, b04c8a3c1c244a42a2eaf39b6cbd045f; no voters:
I20260807 13:37:29.817173 22295 raft_consensus.cc:2781] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:37:29.817700 22295 raft_consensus.cc:686] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 LEADER]: Becoming Leader. State: Replica: b04c8a3c1c244a42a2eaf39b6cbd045f, State: Running, Role: LEADER
I20260807 13:37:29.818246 22066 raft_consensus.cc:2454] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04c8a3c1c244a42a2eaf39b6cbd045f in term 2.
I20260807 13:37:29.818602 22295 consensus_queue.cc:237] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:29.827404 21822 catalog_manager.cc:5495] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f reported cstate change: term changed from 1 to 2, leader changed from e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2) to b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3). New cstate: current_term: 2 leader_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: HEALTHY } } }
I20260807 13:37:29.858346 22354 raft_consensus.cc:979] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f: : Instructing follower 80268d1371f34a9383de934902767138 to start an election
I20260807 13:37:29.858871 22354 raft_consensus.cc:1067] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 LEADER]: Signalling peer 80268d1371f34a9383de934902767138 to start an election
I20260807 13:37:29.860663 21965 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7026bb7599934e0799edcd002a653f67"
dest_uuid: "80268d1371f34a9383de934902767138"
from {username='slave'} at 127.0.0.1:49796
I20260807 13:37:29.861328 21965 raft_consensus.cc:482] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:37:29.861752 21965 raft_consensus.cc:3037] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:29.869021 21965 raft_consensus.cc:504] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:29.872354 21965 leader_election.cc:288] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 2 election: Requested vote from peers e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:29.872359 22066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7026bb7599934e0799edcd002a653f67" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
I20260807 13:37:29.872822 22170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7026bb7599934e0799edcd002a653f67" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
I20260807 13:37:29.873497 22170 raft_consensus.cc:3032] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:37:29.873667 22066 raft_consensus.cc:3037] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:29.873858 22170 raft_consensus.cc:729] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b04c8a3c1c244a42a2eaf39b6cbd045f, State: Running, Role: LEADER
I20260807 13:37:29.874650 22170 consensus_queue.cc:260] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:29.875721 22170 raft_consensus.cc:3037] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:29.880229 22170 raft_consensus.cc:2454] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80268d1371f34a9383de934902767138 in term 2.
I20260807 13:37:29.881273 21919 leader_election.cc:302] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80268d1371f34a9383de934902767138, b04c8a3c1c244a42a2eaf39b6cbd045f; no voters:
I20260807 13:37:29.881419 22066 raft_consensus.cc:2454] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80268d1371f34a9383de934902767138 in term 2.
I20260807 13:37:29.881945 22343 raft_consensus.cc:2781] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:37:29.882423 22343 raft_consensus.cc:686] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [term 2 LEADER]: Becoming Leader. State: Replica: 80268d1371f34a9383de934902767138, State: Running, Role: LEADER
I20260807 13:37:29.883251 22343 consensus_queue.cc:237] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:29.890419 21822 catalog_manager.cc:5495] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 reported cstate change: term changed from 1 to 2, leader changed from b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3) to 80268d1371f34a9383de934902767138 (127.21.69.1). New cstate: current_term: 2 leader_uuid: "80268d1371f34a9383de934902767138" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:30.053813 22295 raft_consensus.cc:979] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f: : Instructing follower 80268d1371f34a9383de934902767138 to start an election
I20260807 13:37:30.054328 22354 raft_consensus.cc:1067] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 LEADER]: Signalling peer 80268d1371f34a9383de934902767138 to start an election
I20260807 13:37:30.056051 21965 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "bdd8f5d33fb34ce6a5f5dd56f5a4846d"
dest_uuid: "80268d1371f34a9383de934902767138"
from {username='slave'} at 127.0.0.1:49796
I20260807 13:37:30.056613 21965 raft_consensus.cc:482] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:37:30.056999 21965 raft_consensus.cc:3037] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:30.062186 21965 raft_consensus.cc:504] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:30.063941 21965 leader_election.cc:288] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 2 election: Requested vote from peers e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:30.065097 22066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdd8f5d33fb34ce6a5f5dd56f5a4846d" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
I20260807 13:37:30.065212 22170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdd8f5d33fb34ce6a5f5dd56f5a4846d" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
I20260807 13:37:30.065829 22066 raft_consensus.cc:3037] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:30.065937 22170 raft_consensus.cc:3032] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:37:30.066339 22170 raft_consensus.cc:729] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b04c8a3c1c244a42a2eaf39b6cbd045f, State: Running, Role: LEADER
I20260807 13:37:30.067250 22170 consensus_queue.cc:260] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:30.068727 22170 raft_consensus.cc:3037] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:30.072235 22066 raft_consensus.cc:2454] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80268d1371f34a9383de934902767138 in term 2.
I20260807 13:37:30.073829 21920 leader_election.cc:302] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80268d1371f34a9383de934902767138, e3a48abf21bc4253ab8cfa5df3234768; no voters:
I20260807 13:37:30.074753 22383 raft_consensus.cc:2781] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:37:30.075313 22383 raft_consensus.cc:686] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [term 2 LEADER]: Becoming Leader. State: Replica: 80268d1371f34a9383de934902767138, State: Running, Role: LEADER
I20260807 13:37:30.076392 22383 consensus_queue.cc:237] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:30.079602 22170 raft_consensus.cc:2454] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80268d1371f34a9383de934902767138 in term 2.
I20260807 13:37:30.086700 22383 raft_consensus.cc:979] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138: : Instructing follower e3a48abf21bc4253ab8cfa5df3234768 to start an election
I20260807 13:37:30.087208 22343 raft_consensus.cc:1067] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [term 1 LEADER]: Signalling peer e3a48abf21bc4253ab8cfa5df3234768 to start an election
I20260807 13:37:30.088130 21822 catalog_manager.cc:5495] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 reported cstate change: term changed from 1 to 2, leader changed from b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3) to 80268d1371f34a9383de934902767138 (127.21.69.1). New cstate: current_term: 2 leader_uuid: "80268d1371f34a9383de934902767138" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:30.089231 22066 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1ba53dccaae2468baf467e13e4ae3738"
dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
from {username='slave'} at 127.0.0.1:36080
I20260807 13:37:30.090184 22066 raft_consensus.cc:482] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:37:30.090736 22066 raft_consensus.cc:3037] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:30.098131 22066 raft_consensus.cc:504] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:30.101325 21965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba53dccaae2468baf467e13e4ae3738" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "80268d1371f34a9383de934902767138"
I20260807 13:37:30.102017 21965 raft_consensus.cc:3032] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:37:30.102005 22170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba53dccaae2468baf467e13e4ae3738" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
I20260807 13:37:30.102651 21965 raft_consensus.cc:729] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80268d1371f34a9383de934902767138, State: Running, Role: LEADER
I20260807 13:37:30.102852 22170 raft_consensus.cc:3037] T 1ba53dccaae2468baf467e13e4ae3738 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:30.102298 22066 leader_election.cc:288] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 2 election: Requested vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:30.103577 21965 consensus_queue.cc:260] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:30.105105 21965 raft_consensus.cc:3037] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:30.108753 22066 raft_consensus.cc:1261] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Refusing update from remote peer 80268d1371f34a9383de934902767138: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:37:30.110307 22343 consensus_queue.cc:1035] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:37:30.112427 21965 raft_consensus.cc:2454] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a48abf21bc4253ab8cfa5df3234768 in term 2.
I20260807 13:37:30.113469 22170 raft_consensus.cc:2454] T 1ba53dccaae2468baf467e13e4ae3738 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a48abf21bc4253ab8cfa5df3234768 in term 2.
I20260807 13:37:30.114710 22024 leader_election.cc:302] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b04c8a3c1c244a42a2eaf39b6cbd045f, e3a48abf21bc4253ab8cfa5df3234768; no voters:
I20260807 13:37:30.115959 22249 raft_consensus.cc:2781] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:37:30.116425 22249 raft_consensus.cc:686] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [term 2 LEADER]: Becoming Leader. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Running, Role: LEADER
I20260807 13:37:30.117411 22249 consensus_queue.cc:237] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:30.127180 22170 raft_consensus.cc:1261] T af2dd6d4811f4b4b9586296ea6a8043e P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 FOLLOWER]: Refusing update from remote peer 80268d1371f34a9383de934902767138: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:37:30.129035 22340 consensus_queue.cc:1035] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:37:30.130991 21825 catalog_manager.cc:5495] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 reported cstate change: term changed from 1 to 2, leader changed from 80268d1371f34a9383de934902767138 (127.21.69.1) to e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2). New cstate: current_term: 2 leader_uuid: "e3a48abf21bc4253ab8cfa5df3234768" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:30.178342 22295 raft_consensus.cc:979] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f: : Instructing follower e3a48abf21bc4253ab8cfa5df3234768 to start an election
I20260807 13:37:30.178853 22295 raft_consensus.cc:1067] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 LEADER]: Signalling peer e3a48abf21bc4253ab8cfa5df3234768 to start an election
I20260807 13:37:30.180583 22066 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7cc45a0c9f0e4f7fb44e5cdf41d038ee"
dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
from {username='slave'} at 127.0.0.1:36094
I20260807 13:37:30.181088 22066 raft_consensus.cc:482] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:37:30.181352 22066 raft_consensus.cc:3037] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:30.186962 22066 raft_consensus.cc:504] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:30.188859 22066 leader_election.cc:288] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 2 election: Requested vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:30.189826 21965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cc45a0c9f0e4f7fb44e5cdf41d038ee" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "80268d1371f34a9383de934902767138"
I20260807 13:37:30.189879 22170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cc45a0c9f0e4f7fb44e5cdf41d038ee" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
I20260807 13:37:30.190606 21965 raft_consensus.cc:3037] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:30.190613 22170 raft_consensus.cc:3032] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:37:30.191176 22170 raft_consensus.cc:729] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b04c8a3c1c244a42a2eaf39b6cbd045f, State: Running, Role: LEADER
I20260807 13:37:30.191962 22170 consensus_queue.cc:260] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:30.193336 22170 raft_consensus.cc:3037] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:30.197450 21965 raft_consensus.cc:2454] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a48abf21bc4253ab8cfa5df3234768 in term 2.
I20260807 13:37:30.198621 22023 leader_election.cc:302] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80268d1371f34a9383de934902767138, e3a48abf21bc4253ab8cfa5df3234768; no voters:
I20260807 13:37:30.199156 22170 raft_consensus.cc:2454] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a48abf21bc4253ab8cfa5df3234768 in term 2.
I20260807 13:37:30.199450 22249 raft_consensus.cc:2781] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:37:30.199949 22249 raft_consensus.cc:686] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [term 2 LEADER]: Becoming Leader. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Running, Role: LEADER
I20260807 13:37:30.200821 22249 consensus_queue.cc:237] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:30.207818 21825 catalog_manager.cc:5495] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 reported cstate change: term changed from 1 to 2, leader changed from b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3) to e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2). New cstate: current_term: 2 leader_uuid: "e3a48abf21bc4253ab8cfa5df3234768" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:30.306948 21965 raft_consensus.cc:1261] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Refusing update from remote peer b04c8a3c1c244a42a2eaf39b6cbd045f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:37:30.308663 22295 consensus_queue.cc:1035] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:37:30.309775 22066 raft_consensus.cc:1261] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Refusing update from remote peer 80268d1371f34a9383de934902767138: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:37:30.311132 22383 consensus_queue.cc:1035] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:37:30.317869 22069 raft_consensus.cc:1261] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Refusing update from remote peer b04c8a3c1c244a42a2eaf39b6cbd045f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:37:30.322127 22354 consensus_queue.cc:1035] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:37:30.322671 22170 raft_consensus.cc:1261] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 FOLLOWER]: Refusing update from remote peer 80268d1371f34a9383de934902767138: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:37:30.324144 22340 consensus_queue.cc:1035] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:37:30.518219 21965 raft_consensus.cc:1261] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Refusing update from remote peer e3a48abf21bc4253ab8cfa5df3234768: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:37:30.519709 22372 consensus_queue.cc:1035] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:37:30.529341 22170 raft_consensus.cc:1261] T 1ba53dccaae2468baf467e13e4ae3738 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 FOLLOWER]: Refusing update from remote peer e3a48abf21bc4253ab8cfa5df3234768: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:37:30.531474 22249 consensus_queue.cc:1035] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:37:30.558825 22170 raft_consensus.cc:1261] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 FOLLOWER]: Refusing update from remote peer 80268d1371f34a9383de934902767138: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:37:30.560082 22383 consensus_queue.cc:1035] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:37:30.569465 22069 raft_consensus.cc:1261] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Refusing update from remote peer 80268d1371f34a9383de934902767138: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:37:30.571062 22383 consensus_queue.cc:1035] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:37:30.696165 22170 raft_consensus.cc:1261] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 FOLLOWER]: Refusing update from remote peer e3a48abf21bc4253ab8cfa5df3234768: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:37:30.697475 22249 consensus_queue.cc:1035] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:37:30.710383 21965 raft_consensus.cc:1261] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Refusing update from remote peer e3a48abf21bc4253ab8cfa5df3234768: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:37:30.712625 22396 consensus_queue.cc:1035] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:37:32.744567 21780 auto_leader_rebalancer-test.cc:269] The leader distribution is
I20260807 13:37:32.745651 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:37:32.769608 21965 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7fb75c03887d4004ba72504f437cd753"
dest_uuid: "80268d1371f34a9383de934902767138"
mode: GRACEFUL
new_leader_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
from {username='slave'} at 127.0.0.1:49820
I20260807 13:37:32.770193 21965 raft_consensus.cc:595] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [term 1 LEADER]: Received request to transfer leadership to TS b04c8a3c1c244a42a2eaf39b6cbd045f
I20260807 13:37:32.783800 22069 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "94c992d4337f48318c5bf5cefae9aaad"
dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
mode: GRACEFUL
new_leader_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
from {username='slave'} at 127.0.0.1:36116
I20260807 13:37:32.784408 22069 raft_consensus.cc:595] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 1 LEADER]: Received request to transfer leadership to TS b04c8a3c1c244a42a2eaf39b6cbd045f
I20260807 13:37:32.785604 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260807 13:37:32.786072 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:37:32.916818 22405 raft_consensus.cc:979] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138: : Instructing follower b04c8a3c1c244a42a2eaf39b6cbd045f to start an election
I20260807 13:37:32.917315 22398 raft_consensus.cc:1067] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [term 1 LEADER]: Signalling peer b04c8a3c1c244a42a2eaf39b6cbd045f to start an election
I20260807 13:37:32.919014 22169 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7fb75c03887d4004ba72504f437cd753"
dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
from {username='slave'} at 127.0.0.1:35096
I20260807 13:37:32.919613 22169 raft_consensus.cc:482] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:37:32.919970 22169 raft_consensus.cc:3037] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:32.925107 22169 raft_consensus.cc:504] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:32.926786 22169 leader_election.cc:288] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 2 election: Requested vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987)
I20260807 13:37:32.927947 22069 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb75c03887d4004ba72504f437cd753" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
I20260807 13:37:32.927944 21965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb75c03887d4004ba72504f437cd753" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "80268d1371f34a9383de934902767138"
I20260807 13:37:32.928807 22069 raft_consensus.cc:3037] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:32.928838 21965 raft_consensus.cc:3032] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:37:32.929422 21965 raft_consensus.cc:729] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80268d1371f34a9383de934902767138, State: Running, Role: LEADER
I20260807 13:37:32.930490 21965 consensus_queue.cc:260] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:32.931980 21965 raft_consensus.cc:3037] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:32.936841 22069 raft_consensus.cc:2454] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04c8a3c1c244a42a2eaf39b6cbd045f in term 2.
I20260807 13:37:32.938268 22124 leader_election.cc:302] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b04c8a3c1c244a42a2eaf39b6cbd045f, e3a48abf21bc4253ab8cfa5df3234768; no voters:
I20260807 13:37:32.939126 22250 raft_consensus.cc:2781] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:37:32.939088 21965 raft_consensus.cc:2454] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04c8a3c1c244a42a2eaf39b6cbd045f in term 2.
I20260807 13:37:32.940985 22250 raft_consensus.cc:686] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 LEADER]: Becoming Leader. State: Replica: b04c8a3c1c244a42a2eaf39b6cbd045f, State: Running, Role: LEADER
I20260807 13:37:32.941807 22250 consensus_queue.cc:237] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:32.949095 21824 catalog_manager.cc:5495] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f reported cstate change: term changed from 1 to 2, leader changed from 80268d1371f34a9383de934902767138 (127.21.69.1) to b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3). New cstate: current_term: 2 leader_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: HEALTHY } } }
I20260807 13:37:33.058101 22414 raft_consensus.cc:979] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768: : Instructing follower b04c8a3c1c244a42a2eaf39b6cbd045f to start an election
I20260807 13:37:33.058643 22249 raft_consensus.cc:1067] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 1 LEADER]: Signalling peer b04c8a3c1c244a42a2eaf39b6cbd045f to start an election
I20260807 13:37:33.060269 22169 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "94c992d4337f48318c5bf5cefae9aaad"
dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
from {username='slave'} at 127.0.0.1:35106
I20260807 13:37:33.060814 22169 raft_consensus.cc:482] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:37:33.061139 22169 raft_consensus.cc:3037] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:33.066286 22169 raft_consensus.cc:504] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:33.068444 22169 leader_election.cc:288] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 2 election: Requested vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987)
I20260807 13:37:33.069216 21965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94c992d4337f48318c5bf5cefae9aaad" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "80268d1371f34a9383de934902767138"
I20260807 13:37:33.070006 21965 raft_consensus.cc:3037] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:33.069912 22069 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94c992d4337f48318c5bf5cefae9aaad" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
I20260807 13:37:33.070586 22069 raft_consensus.cc:3032] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:37:33.070950 22069 raft_consensus.cc:729] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Running, Role: LEADER
I20260807 13:37:33.071796 22069 consensus_queue.cc:260] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:33.073143 22069 raft_consensus.cc:3037] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:33.077703 21965 raft_consensus.cc:2454] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04c8a3c1c244a42a2eaf39b6cbd045f in term 2.
I20260807 13:37:33.079028 22121 leader_election.cc:302] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80268d1371f34a9383de934902767138, b04c8a3c1c244a42a2eaf39b6cbd045f; no voters:
I20260807 13:37:33.079843 22250 raft_consensus.cc:2781] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:37:33.080392 22250 raft_consensus.cc:686] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 LEADER]: Becoming Leader. State: Replica: b04c8a3c1c244a42a2eaf39b6cbd045f, State: Running, Role: LEADER
I20260807 13:37:33.080305 22069 raft_consensus.cc:2454] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04c8a3c1c244a42a2eaf39b6cbd045f in term 2.
I20260807 13:37:33.081292 22250 consensus_queue.cc:237] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:33.088920 21824 catalog_manager.cc:5495] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f reported cstate change: term changed from 1 to 2, leader changed from e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2) to b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3). New cstate: current_term: 2 leader_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: HEALTHY } } }
I20260807 13:37:33.434345 21965 raft_consensus.cc:1261] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Refusing update from remote peer b04c8a3c1c244a42a2eaf39b6cbd045f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:37:33.435765 22250 consensus_queue.cc:1035] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:37:33.449008 22069 raft_consensus.cc:1261] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Refusing update from remote peer b04c8a3c1c244a42a2eaf39b6cbd045f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:37:33.450632 22406 consensus_queue.cc:1035] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:37:33.636431 22069 raft_consensus.cc:1261] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Refusing update from remote peer b04c8a3c1c244a42a2eaf39b6cbd045f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:37:33.638129 22406 consensus_queue.cc:1035] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:37:33.647722 21965 raft_consensus.cc:1261] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Refusing update from remote peer b04c8a3c1c244a42a2eaf39b6cbd045f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:37:33.649462 22427 consensus_queue.cc:1035] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:37:33.786985 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:37:33.792528 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:37:33.793035 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:37:34.794368 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:37:34.804008 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:37:34.804584 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:37:35.805538 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:37:35.810396 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:37:35.810949 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:37:36.811934 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:37:36.817390 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:37:36.817889 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:37:37.818850 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:37:37.823868 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:37:37.824379 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:37:38.825346 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:37:38.830500 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:37:38.830960 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:37:39.831835 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:37:39.836601 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:37:39.837059 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:37:40.838022 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:37:40.842777 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:37:40.843276 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:37:41.844183 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:37:41.848845 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:37:41.849318 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:37:42.877213 21780 auto_leader_rebalancer-test.cc:288] The leader distribution is
I20260807 13:37:42.881903 21960 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bdd8f5d33fb34ce6a5f5dd56f5a4846d"
dest_uuid: "80268d1371f34a9383de934902767138"
mode: GRACEFUL
new_leader_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
from {username='slave'} at 127.0.0.1:49816
I20260807 13:37:42.882685 21960 raft_consensus.cc:595] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [term 2 LEADER]: Received request to transfer leadership to TS e3a48abf21bc4253ab8cfa5df3234768
I20260807 13:37:42.888155 22169 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7fb75c03887d4004ba72504f437cd753"
dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
mode: GRACEFUL
new_leader_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
from {username='slave'} at 127.0.0.1:35120
I20260807 13:37:42.888660 22169 raft_consensus.cc:595] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 LEADER]: Received request to transfer leadership to TS e3a48abf21bc4253ab8cfa5df3234768
I20260807 13:37:42.893891 21965 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7026bb7599934e0799edcd002a653f67"
dest_uuid: "80268d1371f34a9383de934902767138"
mode: GRACEFUL
new_leader_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
from {username='slave'} at 127.0.0.1:49816
I20260807 13:37:42.894449 21965 raft_consensus.cc:595] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [term 2 LEADER]: Received request to transfer leadership to TS e3a48abf21bc4253ab8cfa5df3234768
I20260807 13:37:42.899611 21965 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "af2dd6d4811f4b4b9586296ea6a8043e"
dest_uuid: "80268d1371f34a9383de934902767138"
mode: GRACEFUL
new_leader_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
from {username='slave'} at 127.0.0.1:49816
I20260807 13:37:42.900225 21965 raft_consensus.cc:595] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [term 2 LEADER]: Received request to transfer leadership to TS e3a48abf21bc4253ab8cfa5df3234768
I20260807 13:37:42.914494 22169 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "94c992d4337f48318c5bf5cefae9aaad"
dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
mode: GRACEFUL
new_leader_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
from {username='slave'} at 127.0.0.1:35120
I20260807 13:37:42.915063 22169 raft_consensus.cc:595] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 LEADER]: Received request to transfer leadership to TS e3a48abf21bc4253ab8cfa5df3234768
I20260807 13:37:42.918581 22449 raft_consensus.cc:979] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f: : Instructing follower e3a48abf21bc4253ab8cfa5df3234768 to start an election
I20260807 13:37:42.919165 22447 raft_consensus.cc:1067] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 LEADER]: Signalling peer e3a48abf21bc4253ab8cfa5df3234768 to start an election
I20260807 13:37:42.920822 22066 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7fb75c03887d4004ba72504f437cd753"
dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
from {username='slave'} at 127.0.0.1:36094
I20260807 13:37:42.921301 22066 raft_consensus.cc:482] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:37:42.921607 22066 raft_consensus.cc:3037] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:37:42.927187 22066 raft_consensus.cc:504] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:42.929320 22066 leader_election.cc:288] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 3 election: Requested vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:42.930238 21965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb75c03887d4004ba72504f437cd753" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "80268d1371f34a9383de934902767138"
I20260807 13:37:42.931124 21965 raft_consensus.cc:3037] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:37:42.931005 22169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb75c03887d4004ba72504f437cd753" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
I20260807 13:37:42.931797 22169 raft_consensus.cc:3032] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:37:42.932152 22169 raft_consensus.cc:729] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b04c8a3c1c244a42a2eaf39b6cbd045f, State: Running, Role: LEADER
I20260807 13:37:42.932914 22169 consensus_queue.cc:260] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:42.934270 22169 raft_consensus.cc:3037] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:37:42.938373 21965 raft_consensus.cc:2454] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a48abf21bc4253ab8cfa5df3234768 in term 3.
I20260807 13:37:42.939833 22023 leader_election.cc:302] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80268d1371f34a9383de934902767138, e3a48abf21bc4253ab8cfa5df3234768; no voters:
I20260807 13:37:42.940557 22169 raft_consensus.cc:2454] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a48abf21bc4253ab8cfa5df3234768 in term 3.
I20260807 13:37:42.940709 22435 raft_consensus.cc:2781] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:37:42.941820 22435 raft_consensus.cc:686] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [term 3 LEADER]: Becoming Leader. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Running, Role: LEADER
I20260807 13:37:42.942776 22435 consensus_queue.cc:237] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:42.950178 21824 catalog_manager.cc:5495] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 reported cstate change: term changed from 2 to 3, leader changed from b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3) to e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2). New cstate: current_term: 3 leader_uuid: "e3a48abf21bc4253ab8cfa5df3234768" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:43.080551 22459 raft_consensus.cc:979] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138: : Instructing follower e3a48abf21bc4253ab8cfa5df3234768 to start an election
I20260807 13:37:43.081396 22439 raft_consensus.cc:1067] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [term 2 LEADER]: Signalling peer e3a48abf21bc4253ab8cfa5df3234768 to start an election
I20260807 13:37:43.083206 22066 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7026bb7599934e0799edcd002a653f67"
dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
from {username='slave'} at 127.0.0.1:36080
I20260807 13:37:43.083832 22066 raft_consensus.cc:482] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:37:43.084143 22066 raft_consensus.cc:3037] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:37:43.090579 22066 raft_consensus.cc:504] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:43.092960 22066 leader_election.cc:288] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 3 election: Requested vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:43.093972 21965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7026bb7599934e0799edcd002a653f67" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "80268d1371f34a9383de934902767138"
I20260807 13:37:43.094199 22169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7026bb7599934e0799edcd002a653f67" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
I20260807 13:37:43.094527 21965 raft_consensus.cc:3032] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:37:43.094751 22169 raft_consensus.cc:3037] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:37:43.094866 21965 raft_consensus.cc:729] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 80268d1371f34a9383de934902767138, State: Running, Role: LEADER
I20260807 13:37:43.095590 21965 consensus_queue.cc:260] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:43.096676 21965 raft_consensus.cc:3037] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:37:43.099928 22169 raft_consensus.cc:2454] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a48abf21bc4253ab8cfa5df3234768 in term 3.
I20260807 13:37:43.101433 21965 raft_consensus.cc:2454] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a48abf21bc4253ab8cfa5df3234768 in term 3.
I20260807 13:37:43.101532 22024 leader_election.cc:302] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b04c8a3c1c244a42a2eaf39b6cbd045f, e3a48abf21bc4253ab8cfa5df3234768; no voters:
I20260807 13:37:43.102674 22435 raft_consensus.cc:2781] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:37:43.103194 22435 raft_consensus.cc:686] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [term 3 LEADER]: Becoming Leader. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Running, Role: LEADER
I20260807 13:37:43.104090 22435 consensus_queue.cc:237] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:43.111827 21824 catalog_manager.cc:5495] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 reported cstate change: term changed from 2 to 3, leader changed from 80268d1371f34a9383de934902767138 (127.21.69.1) to e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2). New cstate: current_term: 3 leader_uuid: "e3a48abf21bc4253ab8cfa5df3234768" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:43.273764 22449 raft_consensus.cc:979] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f: : Instructing follower e3a48abf21bc4253ab8cfa5df3234768 to start an election
I20260807 13:37:43.274246 22447 raft_consensus.cc:1067] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 LEADER]: Signalling peer e3a48abf21bc4253ab8cfa5df3234768 to start an election
I20260807 13:37:43.275884 22066 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "94c992d4337f48318c5bf5cefae9aaad"
dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
from {username='slave'} at 127.0.0.1:36094
I20260807 13:37:43.276393 22066 raft_consensus.cc:482] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:37:43.276695 22066 raft_consensus.cc:3037] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:37:43.281641 22066 raft_consensus.cc:504] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:43.284004 22066 leader_election.cc:288] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 3 election: Requested vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:43.284914 21965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94c992d4337f48318c5bf5cefae9aaad" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "80268d1371f34a9383de934902767138"
I20260807 13:37:43.285087 22169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94c992d4337f48318c5bf5cefae9aaad" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
I20260807 13:37:43.285537 21965 raft_consensus.cc:3037] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:37:43.285585 22169 raft_consensus.cc:3032] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:37:43.286038 22169 raft_consensus.cc:729] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b04c8a3c1c244a42a2eaf39b6cbd045f, State: Running, Role: LEADER
I20260807 13:37:43.286783 22169 consensus_queue.cc:260] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:43.287962 22169 raft_consensus.cc:3037] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:37:43.292555 21965 raft_consensus.cc:2454] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a48abf21bc4253ab8cfa5df3234768 in term 3.
I20260807 13:37:43.293745 22023 leader_election.cc:302] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80268d1371f34a9383de934902767138, e3a48abf21bc4253ab8cfa5df3234768; no voters:
I20260807 13:37:43.294330 22169 raft_consensus.cc:2454] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a48abf21bc4253ab8cfa5df3234768 in term 3.
I20260807 13:37:43.294490 22435 raft_consensus.cc:2781] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:37:43.294994 22435 raft_consensus.cc:686] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 3 LEADER]: Becoming Leader. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Running, Role: LEADER
I20260807 13:37:43.295953 22435 consensus_queue.cc:237] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:43.303706 21824 catalog_manager.cc:5495] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 reported cstate change: term changed from 2 to 3, leader changed from b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3) to e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2). New cstate: current_term: 3 leader_uuid: "e3a48abf21bc4253ab8cfa5df3234768" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:43.396046 22459 raft_consensus.cc:979] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138: : Instructing follower e3a48abf21bc4253ab8cfa5df3234768 to start an election
I20260807 13:37:43.396533 22439 raft_consensus.cc:1067] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [term 2 LEADER]: Signalling peer e3a48abf21bc4253ab8cfa5df3234768 to start an election
I20260807 13:37:43.398087 22066 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "bdd8f5d33fb34ce6a5f5dd56f5a4846d"
dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
from {username='slave'} at 127.0.0.1:36080
I20260807 13:37:43.398646 22066 raft_consensus.cc:482] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:37:43.398959 22066 raft_consensus.cc:3037] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:37:43.403991 21965 raft_consensus.cc:1261] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [term 3 FOLLOWER]: Refusing update from remote peer e3a48abf21bc4253ab8cfa5df3234768: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:37:43.405599 22435 consensus_queue.cc:1035] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:37:43.405738 22066 raft_consensus.cc:504] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:43.407562 22066 leader_election.cc:288] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 3 election: Requested vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:43.408653 21960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdd8f5d33fb34ce6a5f5dd56f5a4846d" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "80268d1371f34a9383de934902767138"
I20260807 13:37:43.409067 22169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdd8f5d33fb34ce6a5f5dd56f5a4846d" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
I20260807 13:37:43.409369 21960 raft_consensus.cc:3032] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:37:43.409669 22169 raft_consensus.cc:3037] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:37:43.409732 21960 raft_consensus.cc:729] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 80268d1371f34a9383de934902767138, State: Running, Role: LEADER
I20260807 13:37:43.410632 21960 consensus_queue.cc:260] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:43.412253 21960 raft_consensus.cc:3037] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:37:43.421022 21960 raft_consensus.cc:2454] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a48abf21bc4253ab8cfa5df3234768 in term 3.
I20260807 13:37:43.421432 22169 raft_consensus.cc:2454] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a48abf21bc4253ab8cfa5df3234768 in term 3.
I20260807 13:37:43.424803 22023 leader_election.cc:302] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80268d1371f34a9383de934902767138, e3a48abf21bc4253ab8cfa5df3234768; no voters:
I20260807 13:37:43.426673 22435 raft_consensus.cc:2781] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:37:43.429952 22169 raft_consensus.cc:1261] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Refusing update from remote peer e3a48abf21bc4253ab8cfa5df3234768: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:37:43.431049 22435 raft_consensus.cc:686] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [term 3 LEADER]: Becoming Leader. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Running, Role: LEADER
I20260807 13:37:43.431734 22470 consensus_queue.cc:1035] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:37:43.432192 22435 consensus_queue.cc:237] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:43.440337 21824 catalog_manager.cc:5495] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 reported cstate change: term changed from 2 to 3, leader changed from 80268d1371f34a9383de934902767138 (127.21.69.1) to e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2). New cstate: current_term: 3 leader_uuid: "e3a48abf21bc4253ab8cfa5df3234768" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:43.459062 22459 raft_consensus.cc:979] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138: : Instructing follower e3a48abf21bc4253ab8cfa5df3234768 to start an election
I20260807 13:37:43.459510 22439 raft_consensus.cc:1067] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [term 2 LEADER]: Signalling peer e3a48abf21bc4253ab8cfa5df3234768 to start an election
I20260807 13:37:43.460935 22066 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "af2dd6d4811f4b4b9586296ea6a8043e"
dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
from {username='slave'} at 127.0.0.1:36080
I20260807 13:37:43.461444 22066 raft_consensus.cc:482] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:37:43.461766 22066 raft_consensus.cc:3037] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:37:43.467264 22066 raft_consensus.cc:504] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:43.469069 22066 leader_election.cc:288] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 3 election: Requested vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:43.469987 21965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af2dd6d4811f4b4b9586296ea6a8043e" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "80268d1371f34a9383de934902767138"
I20260807 13:37:43.470173 22169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af2dd6d4811f4b4b9586296ea6a8043e" candidate_uuid: "e3a48abf21bc4253ab8cfa5df3234768" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
I20260807 13:37:43.470626 21965 raft_consensus.cc:3032] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:37:43.470719 22169 raft_consensus.cc:3037] T af2dd6d4811f4b4b9586296ea6a8043e P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:37:43.470920 21965 raft_consensus.cc:729] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 80268d1371f34a9383de934902767138, State: Running, Role: LEADER
I20260807 13:37:43.471626 21965 consensus_queue.cc:260] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:43.472867 21965 raft_consensus.cc:3037] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:37:43.475834 22169 raft_consensus.cc:2454] T af2dd6d4811f4b4b9586296ea6a8043e P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a48abf21bc4253ab8cfa5df3234768 in term 3.
I20260807 13:37:43.476818 22024 leader_election.cc:302] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b04c8a3c1c244a42a2eaf39b6cbd045f, e3a48abf21bc4253ab8cfa5df3234768; no voters:
I20260807 13:37:43.477667 22435 raft_consensus.cc:2781] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:37:43.478052 21965 raft_consensus.cc:2454] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a48abf21bc4253ab8cfa5df3234768 in term 3.
I20260807 13:37:43.478089 22435 raft_consensus.cc:686] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [term 3 LEADER]: Becoming Leader. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Running, Role: LEADER
I20260807 13:37:43.479131 22435 consensus_queue.cc:237] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:43.486651 21825 catalog_manager.cc:5495] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 reported cstate change: term changed from 2 to 3, leader changed from 80268d1371f34a9383de934902767138 (127.21.69.1) to e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2). New cstate: current_term: 3 leader_uuid: "e3a48abf21bc4253ab8cfa5df3234768" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:43.634701 21965 raft_consensus.cc:1261] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [term 3 FOLLOWER]: Refusing update from remote peer e3a48abf21bc4253ab8cfa5df3234768: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:37:43.635953 22435 consensus_queue.cc:1035] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:37:43.642380 22169 raft_consensus.cc:1261] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Refusing update from remote peer e3a48abf21bc4253ab8cfa5df3234768: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:37:43.644454 22468 consensus_queue.cc:1035] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:37:43.766320 22169 raft_consensus.cc:1261] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Refusing update from remote peer e3a48abf21bc4253ab8cfa5df3234768: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:37:43.767901 22468 consensus_queue.cc:1035] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:37:43.778462 21965 raft_consensus.cc:1261] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [term 3 FOLLOWER]: Refusing update from remote peer e3a48abf21bc4253ab8cfa5df3234768: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:37:43.779887 22468 consensus_queue.cc:1035] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:37:43.870987 22169 raft_consensus.cc:1261] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Refusing update from remote peer e3a48abf21bc4253ab8cfa5df3234768: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:37:43.872660 22468 consensus_queue.cc:1035] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:37:43.883054 21965 raft_consensus.cc:1261] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [term 3 FOLLOWER]: Refusing update from remote peer e3a48abf21bc4253ab8cfa5df3234768: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:37:43.884650 22435 consensus_queue.cc:1035] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:37:43.891631 22169 raft_consensus.cc:1261] T af2dd6d4811f4b4b9586296ea6a8043e P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Refusing update from remote peer e3a48abf21bc4253ab8cfa5df3234768: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:37:43.893316 22468 consensus_queue.cc:1035] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:37:43.909296 21965 raft_consensus.cc:1261] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [term 3 FOLLOWER]: Refusing update from remote peer e3a48abf21bc4253ab8cfa5df3234768: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:37:43.911257 22435 consensus_queue.cc:1035] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:37:45.948966 21780 auto_leader_rebalancer-test.cc:303] The leader distribution is
I20260807 13:37:45.949803 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:37:45.956579 22066 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1ba53dccaae2468baf467e13e4ae3738"
dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
mode: GRACEFUL
new_leader_uuid: "80268d1371f34a9383de934902767138"
from {username='slave'} at 127.0.0.1:36116
I20260807 13:37:45.957357 22066 raft_consensus.cc:595] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [term 2 LEADER]: Received request to transfer leadership to TS 80268d1371f34a9383de934902767138
I20260807 13:37:45.960115 22066 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7026bb7599934e0799edcd002a653f67"
dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
mode: GRACEFUL
new_leader_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
from {username='slave'} at 127.0.0.1:36116
I20260807 13:37:45.960601 22066 raft_consensus.cc:595] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [term 3 LEADER]: Received request to transfer leadership to TS b04c8a3c1c244a42a2eaf39b6cbd045f
I20260807 13:37:45.962741 22066 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7cc45a0c9f0e4f7fb44e5cdf41d038ee"
dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
mode: GRACEFUL
new_leader_uuid: "80268d1371f34a9383de934902767138"
from {username='slave'} at 127.0.0.1:36116
I20260807 13:37:45.963199 22066 raft_consensus.cc:595] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [term 2 LEADER]: Received request to transfer leadership to TS 80268d1371f34a9383de934902767138
I20260807 13:37:45.965394 22066 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "94c992d4337f48318c5bf5cefae9aaad"
dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
mode: GRACEFUL
new_leader_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
from {username='slave'} at 127.0.0.1:36116
I20260807 13:37:45.965916 22066 raft_consensus.cc:595] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 3 LEADER]: Received request to transfer leadership to TS b04c8a3c1c244a42a2eaf39b6cbd045f
I20260807 13:37:45.968155 22066 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bdd8f5d33fb34ce6a5f5dd56f5a4846d"
dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
mode: GRACEFUL
new_leader_uuid: "80268d1371f34a9383de934902767138"
from {username='slave'} at 127.0.0.1:36116
I20260807 13:37:45.968597 22066 raft_consensus.cc:595] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [term 3 LEADER]: Received request to transfer leadership to TS 80268d1371f34a9383de934902767138
I20260807 13:37:45.969585 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260807 13:37:45.970052 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:37:45.987838 22451 raft_consensus.cc:979] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768: : Instructing follower 80268d1371f34a9383de934902767138 to start an election
I20260807 13:37:45.988427 22435 raft_consensus.cc:1067] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [term 2 LEADER]: Signalling peer 80268d1371f34a9383de934902767138 to start an election
I20260807 13:37:45.989988 21960 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7cc45a0c9f0e4f7fb44e5cdf41d038ee"
dest_uuid: "80268d1371f34a9383de934902767138"
from {username='slave'} at 127.0.0.1:49808
I20260807 13:37:45.990584 21960 raft_consensus.cc:482] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:37:45.990944 21960 raft_consensus.cc:3037] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:37:45.997452 21960 raft_consensus.cc:504] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:46.000008 21960 leader_election.cc:288] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 3 election: Requested vote from peers e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:46.001190 22066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cc45a0c9f0e4f7fb44e5cdf41d038ee" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
I20260807 13:37:46.001590 22169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cc45a0c9f0e4f7fb44e5cdf41d038ee" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
I20260807 13:37:46.002130 22066 raft_consensus.cc:3032] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:37:46.002171 22169 raft_consensus.cc:3037] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:37:46.002540 22066 raft_consensus.cc:729] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Running, Role: LEADER
I20260807 13:37:46.003278 22066 consensus_queue.cc:260] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:46.004456 22066 raft_consensus.cc:3037] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:37:46.008531 22169 raft_consensus.cc:2454] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80268d1371f34a9383de934902767138 in term 3.
I20260807 13:37:46.010056 21919 leader_election.cc:302] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80268d1371f34a9383de934902767138, b04c8a3c1c244a42a2eaf39b6cbd045f; no voters:
I20260807 13:37:46.011241 22066 raft_consensus.cc:2454] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80268d1371f34a9383de934902767138 in term 3.
I20260807 13:37:46.012931 22493 raft_consensus.cc:2781] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:37:46.015013 22493 raft_consensus.cc:686] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 [term 3 LEADER]: Becoming Leader. State: Replica: 80268d1371f34a9383de934902767138, State: Running, Role: LEADER
I20260807 13:37:46.016428 22435 raft_consensus.cc:979] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768: : Instructing follower 80268d1371f34a9383de934902767138 to start an election
I20260807 13:37:46.016201 22493 consensus_queue.cc:237] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:46.016892 22451 raft_consensus.cc:1067] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [term 3 LEADER]: Signalling peer 80268d1371f34a9383de934902767138 to start an election
I20260807 13:37:46.018572 21960 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "bdd8f5d33fb34ce6a5f5dd56f5a4846d"
dest_uuid: "80268d1371f34a9383de934902767138"
from {username='slave'} at 127.0.0.1:49808
I20260807 13:37:46.019223 21960 raft_consensus.cc:482] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:37:46.019805 21960 raft_consensus.cc:3037] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:37:46.024062 21822 catalog_manager.cc:5495] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 reported cstate change: term changed from 2 to 3, leader changed from e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2) to 80268d1371f34a9383de934902767138 (127.21.69.1). New cstate: current_term: 3 leader_uuid: "80268d1371f34a9383de934902767138" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:46.026796 21960 raft_consensus.cc:504] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:46.028707 21960 leader_election.cc:288] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 4 election: Requested vote from peers e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:46.029736 22066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdd8f5d33fb34ce6a5f5dd56f5a4846d" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
I20260807 13:37:46.029937 22169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdd8f5d33fb34ce6a5f5dd56f5a4846d" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
I20260807 13:37:46.030376 22066 raft_consensus.cc:3032] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:37:46.030481 22169 raft_consensus.cc:3037] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:37:46.030768 22066 raft_consensus.cc:729] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Running, Role: LEADER
I20260807 13:37:46.031749 22066 consensus_queue.cc:260] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:46.032958 22066 raft_consensus.cc:3037] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:37:46.037819 22169 raft_consensus.cc:2454] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80268d1371f34a9383de934902767138 in term 4.
I20260807 13:37:46.039197 21919 leader_election.cc:302] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80268d1371f34a9383de934902767138, b04c8a3c1c244a42a2eaf39b6cbd045f; no voters:
I20260807 13:37:46.039359 22066 raft_consensus.cc:2454] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80268d1371f34a9383de934902767138 in term 4.
I20260807 13:37:46.041222 22493 raft_consensus.cc:2781] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:37:46.041795 22493 raft_consensus.cc:686] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [term 4 LEADER]: Becoming Leader. State: Replica: 80268d1371f34a9383de934902767138, State: Running, Role: LEADER
I20260807 13:37:46.042744 22493 consensus_queue.cc:237] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:46.051187 21822 catalog_manager.cc:5495] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 reported cstate change: term changed from 3 to 4, leader changed from e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2) to 80268d1371f34a9383de934902767138 (127.21.69.1). New cstate: current_term: 4 leader_uuid: "80268d1371f34a9383de934902767138" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:46.099685 22435 raft_consensus.cc:979] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768: : Instructing follower b04c8a3c1c244a42a2eaf39b6cbd045f to start an election
I20260807 13:37:46.100174 22451 raft_consensus.cc:1067] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 3 LEADER]: Signalling peer b04c8a3c1c244a42a2eaf39b6cbd045f to start an election
I20260807 13:37:46.101763 22169 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "94c992d4337f48318c5bf5cefae9aaad"
dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
from {username='slave'} at 127.0.0.1:35106
I20260807 13:37:46.102171 22169 raft_consensus.cc:482] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:37:46.102409 22169 raft_consensus.cc:3037] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:37:46.107036 22169 raft_consensus.cc:504] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:46.109041 22169 leader_election.cc:288] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 4 election: Requested vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987)
I20260807 13:37:46.110064 22066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94c992d4337f48318c5bf5cefae9aaad" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
I20260807 13:37:46.110074 21960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94c992d4337f48318c5bf5cefae9aaad" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "80268d1371f34a9383de934902767138"
I20260807 13:37:46.110643 22066 raft_consensus.cc:3032] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:37:46.110771 21960 raft_consensus.cc:3037] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:37:46.110932 22066 raft_consensus.cc:729] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Running, Role: LEADER
I20260807 13:37:46.111740 22066 consensus_queue.cc:260] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:46.112717 22066 raft_consensus.cc:3037] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:37:46.116560 21960 raft_consensus.cc:2454] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04c8a3c1c244a42a2eaf39b6cbd045f in term 4.
I20260807 13:37:46.117725 22066 raft_consensus.cc:2454] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04c8a3c1c244a42a2eaf39b6cbd045f in term 4.
I20260807 13:37:46.117962 22121 leader_election.cc:302] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80268d1371f34a9383de934902767138, b04c8a3c1c244a42a2eaf39b6cbd045f; no voters:
I20260807 13:37:46.118968 22447 raft_consensus.cc:2781] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:37:46.120151 22447 raft_consensus.cc:686] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 4 LEADER]: Becoming Leader. State: Replica: b04c8a3c1c244a42a2eaf39b6cbd045f, State: Running, Role: LEADER
I20260807 13:37:46.121034 22447 consensus_queue.cc:237] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:46.128053 21822 catalog_manager.cc:5495] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f reported cstate change: term changed from 3 to 4, leader changed from e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2) to b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3). New cstate: current_term: 4 leader_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: HEALTHY } } }
I20260807 13:37:46.143424 22435 raft_consensus.cc:979] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768: : Instructing follower b04c8a3c1c244a42a2eaf39b6cbd045f to start an election
I20260807 13:37:46.143963 22451 raft_consensus.cc:1067] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [term 3 LEADER]: Signalling peer b04c8a3c1c244a42a2eaf39b6cbd045f to start an election
I20260807 13:37:46.145360 22169 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7026bb7599934e0799edcd002a653f67"
dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
from {username='slave'} at 127.0.0.1:35106
I20260807 13:37:46.145848 22169 raft_consensus.cc:482] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:37:46.146147 22169 raft_consensus.cc:3037] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:37:46.150645 22169 raft_consensus.cc:504] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:46.152243 22169 leader_election.cc:288] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 4 election: Requested vote from peers 80268d1371f34a9383de934902767138 (127.21.69.1:36327), e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987)
I20260807 13:37:46.153388 21960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7026bb7599934e0799edcd002a653f67" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "80268d1371f34a9383de934902767138"
I20260807 13:37:46.153388 22066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7026bb7599934e0799edcd002a653f67" candidate_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
I20260807 13:37:46.154264 21960 raft_consensus.cc:3037] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:37:46.154335 22066 raft_consensus.cc:3032] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:37:46.154803 22066 raft_consensus.cc:729] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Running, Role: LEADER
I20260807 13:37:46.155471 22066 consensus_queue.cc:260] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:46.156447 22066 raft_consensus.cc:3037] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:37:46.160107 21960 raft_consensus.cc:2454] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04c8a3c1c244a42a2eaf39b6cbd045f in term 4.
I20260807 13:37:46.160778 22066 raft_consensus.cc:2454] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04c8a3c1c244a42a2eaf39b6cbd045f in term 4.
I20260807 13:37:46.161360 22121 leader_election.cc:302] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80268d1371f34a9383de934902767138, b04c8a3c1c244a42a2eaf39b6cbd045f; no voters:
I20260807 13:37:46.162209 22447 raft_consensus.cc:2781] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:37:46.162639 22447 raft_consensus.cc:686] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 4 LEADER]: Becoming Leader. State: Replica: b04c8a3c1c244a42a2eaf39b6cbd045f, State: Running, Role: LEADER
I20260807 13:37:46.163443 22447 consensus_queue.cc:237] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:46.170578 21822 catalog_manager.cc:5495] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f reported cstate change: term changed from 3 to 4, leader changed from e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2) to b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3). New cstate: current_term: 4 leader_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: HEALTHY } } }
I20260807 13:37:46.407753 22435 raft_consensus.cc:979] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768: : Instructing follower 80268d1371f34a9383de934902767138 to start an election
I20260807 13:37:46.408200 22451 raft_consensus.cc:1067] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [term 2 LEADER]: Signalling peer 80268d1371f34a9383de934902767138 to start an election
I20260807 13:37:46.409651 21960 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1ba53dccaae2468baf467e13e4ae3738"
dest_uuid: "80268d1371f34a9383de934902767138"
from {username='slave'} at 127.0.0.1:49808
I20260807 13:37:46.410156 21960 raft_consensus.cc:482] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:37:46.410481 21960 raft_consensus.cc:3037] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:37:46.415747 21960 raft_consensus.cc:504] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:46.418152 21960 leader_election.cc:288] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 3 election: Requested vote from peers e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987), b04c8a3c1c244a42a2eaf39b6cbd045f (127.21.69.3:38401)
I20260807 13:37:46.418543 22066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba53dccaae2468baf467e13e4ae3738" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3a48abf21bc4253ab8cfa5df3234768"
I20260807 13:37:46.419147 22066 raft_consensus.cc:3032] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:37:46.419284 22169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba53dccaae2468baf467e13e4ae3738" candidate_uuid: "80268d1371f34a9383de934902767138" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f"
I20260807 13:37:46.419493 22066 raft_consensus.cc:729] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3a48abf21bc4253ab8cfa5df3234768, State: Running, Role: LEADER
I20260807 13:37:46.419869 22169 raft_consensus.cc:3037] T 1ba53dccaae2468baf467e13e4ae3738 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:37:46.420254 22066 consensus_queue.cc:260] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:46.421491 22066 raft_consensus.cc:3037] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:37:46.426678 22169 raft_consensus.cc:2454] T 1ba53dccaae2468baf467e13e4ae3738 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80268d1371f34a9383de934902767138 in term 3.
I20260807 13:37:46.427831 22066 raft_consensus.cc:2454] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80268d1371f34a9383de934902767138 in term 3.
I20260807 13:37:46.427927 21919 leader_election.cc:302] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80268d1371f34a9383de934902767138, b04c8a3c1c244a42a2eaf39b6cbd045f; no voters:
I20260807 13:37:46.428815 22493 raft_consensus.cc:2781] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:37:46.429263 22493 raft_consensus.cc:686] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [term 3 LEADER]: Becoming Leader. State: Replica: 80268d1371f34a9383de934902767138, State: Running, Role: LEADER
I20260807 13:37:46.430061 22493 consensus_queue.cc:237] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } }
I20260807 13:37:46.436729 21822 catalog_manager.cc:5495] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 reported cstate change: term changed from 2 to 3, leader changed from e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2) to 80268d1371f34a9383de934902767138 (127.21.69.1). New cstate: current_term: 3 leader_uuid: "80268d1371f34a9383de934902767138" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:46.489903 22066 raft_consensus.cc:1261] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [term 4 FOLLOWER]: Refusing update from remote peer 80268d1371f34a9383de934902767138: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:37:46.491184 22493 consensus_queue.cc:1035] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:37:46.503372 22169 raft_consensus.cc:1261] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 4 FOLLOWER]: Refusing update from remote peer 80268d1371f34a9383de934902767138: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:37:46.505084 22516 consensus_queue.cc:1035] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:37:46.539141 22169 raft_consensus.cc:1261] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Refusing update from remote peer 80268d1371f34a9383de934902767138: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:37:46.540495 22066 raft_consensus.cc:1261] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 4 FOLLOWER]: Refusing update from remote peer b04c8a3c1c244a42a2eaf39b6cbd045f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:37:46.540503 22516 consensus_queue.cc:1035] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:37:46.541810 22447 consensus_queue.cc:1035] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:37:46.548372 22069 raft_consensus.cc:1261] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [term 3 FOLLOWER]: Refusing update from remote peer 80268d1371f34a9383de934902767138: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:37:46.550069 22516 consensus_queue.cc:1035] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:37:46.564051 21960 raft_consensus.cc:1261] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [term 4 FOLLOWER]: Refusing update from remote peer b04c8a3c1c244a42a2eaf39b6cbd045f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:37:46.566028 22447 consensus_queue.cc:1035] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:37:46.630957 22069 raft_consensus.cc:1261] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [term 4 FOLLOWER]: Refusing update from remote peer b04c8a3c1c244a42a2eaf39b6cbd045f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:37:46.632359 22524 consensus_queue.cc:1035] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:37:46.642375 21960 raft_consensus.cc:1261] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [term 4 FOLLOWER]: Refusing update from remote peer b04c8a3c1c244a42a2eaf39b6cbd045f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:37:46.644515 22507 consensus_queue.cc:1035] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [LEADER]: Connected to new peer: Peer: permanent_uuid: "80268d1371f34a9383de934902767138" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:37:46.925812 22069 raft_consensus.cc:1261] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [term 3 FOLLOWER]: Refusing update from remote peer 80268d1371f34a9383de934902767138: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:37:46.927228 22494 consensus_queue.cc:1035] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a48abf21bc4253ab8cfa5df3234768" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:37:46.936391 22169 raft_consensus.cc:1261] T 1ba53dccaae2468baf467e13e4ae3738 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Refusing update from remote peer 80268d1371f34a9383de934902767138: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:37:46.937879 22494 consensus_queue.cc:1035] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04c8a3c1c244a42a2eaf39b6cbd045f" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 38401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:37:46.971017 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:37:46.975831 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:37:46.976228 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:37:47.977028 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:37:47.981873 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:37:47.982231 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:37:48.983110 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:37:48.987764 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:37:48.988147 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:37:49.988898 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:37:49.993654 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:37:49.994032 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:37:50.994899 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:37:51.001374 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:37:51.001842 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:37:52.002734 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:37:52.008190 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:37:52.008603 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:37:53.009440 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:37:53.015020 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:37:53.015543 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:37:54.016458 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:37:54.021320 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:37:54.021813 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:37:55.022989 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:37:55.028930 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:37:55.029417 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:37:56.059763 21780 auto_leader_rebalancer-test.cc:314] The leader distribution is
I20260807 13:37:56.060527 21780 tablet_server.cc:178] TabletServer@127.21.69.1:0 shutting down...
I20260807 13:37:56.111038 21780 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260807 13:37:56.112118 21780 tablet_replica.cc:330] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138: stopping tablet replica
W20260807 13:37:56.113144 22121 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260807 13:37:56.114142 21780 raft_consensus.cc:2229] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [term 4 LEADER]: Raft consensus shutting down.
I20260807 13:37:56.115590 21780 raft_consensus.cc:2258] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P 80268d1371f34a9383de934902767138 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260807 13:37:56.117048 22121 consensus_peers.cc:487] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f -> Peer 80268d1371f34a9383de934902767138 (127.21.69.1:36327): Couldn't send request to peer 80268d1371f34a9383de934902767138. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:37:56.118765 21780 tablet_replica.cc:330] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138: stopping tablet replica
I20260807 13:37:56.119395 21780 raft_consensus.cc:2229] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 13:37:56.119992 21780 raft_consensus.cc:2258] T 7026bb7599934e0799edcd002a653f67 P 80268d1371f34a9383de934902767138 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.122148 21780 tablet_replica.cc:330] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138: stopping tablet replica
I20260807 13:37:56.122793 21780 raft_consensus.cc:2229] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 13:37:56.123256 21780 raft_consensus.cc:2258] T 94c992d4337f48318c5bf5cefae9aaad P 80268d1371f34a9383de934902767138 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.125166 21780 tablet_replica.cc:330] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138: stopping tablet replica
I20260807 13:37:56.125733 21780 raft_consensus.cc:2229] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 [term 3 LEADER]: Raft consensus shutting down.
I20260807 13:37:56.126672 21780 raft_consensus.cc:2258] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P 80268d1371f34a9383de934902767138 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.128613 21780 tablet_replica.cc:330] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138: stopping tablet replica
I20260807 13:37:56.129190 21780 raft_consensus.cc:2229] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:37:56.129660 21780 raft_consensus.cc:2258] T 01dc391e2ed6419c91dffb6033bd6abe P 80268d1371f34a9383de934902767138 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.131525 21780 tablet_replica.cc:330] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138: stopping tablet replica
I20260807 13:37:56.132154 21780 raft_consensus.cc:2229] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:37:56.132647 21780 raft_consensus.cc:2258] T 7fb75c03887d4004ba72504f437cd753 P 80268d1371f34a9383de934902767138 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.134533 21780 tablet_replica.cc:330] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138: stopping tablet replica
I20260807 13:37:56.135030 21780 raft_consensus.cc:2229] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [term 3 LEADER]: Raft consensus shutting down.
I20260807 13:37:56.135947 21780 raft_consensus.cc:2258] T 1ba53dccaae2468baf467e13e4ae3738 P 80268d1371f34a9383de934902767138 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.137578 21780 tablet_replica.cc:330] T 2030a14e8f0447fdbcaef7c340a1cbbd P 80268d1371f34a9383de934902767138: stopping tablet replica
I20260807 13:37:56.138043 21780 raft_consensus.cc:2229] T 2030a14e8f0447fdbcaef7c340a1cbbd P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:37:56.138459 21780 raft_consensus.cc:2258] T 2030a14e8f0447fdbcaef7c340a1cbbd P 80268d1371f34a9383de934902767138 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.140112 21780 tablet_replica.cc:330] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138: stopping tablet replica
I20260807 13:37:56.140569 21780 raft_consensus.cc:2229] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:37:56.141017 21780 raft_consensus.cc:2258] T af2dd6d4811f4b4b9586296ea6a8043e P 80268d1371f34a9383de934902767138 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.247547 21780 tablet_server.cc:194] TabletServer@127.21.69.1:0 shutdown complete.
W20260807 13:37:56.247555 22023 consensus_peers.cc:487] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 -> Peer 80268d1371f34a9383de934902767138 (127.21.69.1:36327): Couldn't send request to peer 80268d1371f34a9383de934902767138. Status: Network error: Client connection negotiation failed: client connection to 127.21.69.1:36327: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:37:56.268517 21780 tablet_server.cc:178] TabletServer@127.21.69.2:0 shutting down...
W20260807 13:37:56.292662 22121 consensus_peers.cc:487] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f -> Peer 80268d1371f34a9383de934902767138 (127.21.69.1:36327): Couldn't send request to peer 80268d1371f34a9383de934902767138. Status: Network error: Client connection negotiation failed: client connection to 127.21.69.1:36327: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:37:56.305927 21780 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260807 13:37:56.306777 21780 tablet_replica.cc:330] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768: stopping tablet replica
I20260807 13:37:56.307471 21780 raft_consensus.cc:2229] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 13:37:56.308073 21780 raft_consensus.cc:2258] T 7026bb7599934e0799edcd002a653f67 P e3a48abf21bc4253ab8cfa5df3234768 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.309821 21780 tablet_replica.cc:330] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768: stopping tablet replica
I20260807 13:37:56.310313 21780 raft_consensus.cc:2229] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 13:37:56.310659 21780 raft_consensus.cc:2258] T 94c992d4337f48318c5bf5cefae9aaad P e3a48abf21bc4253ab8cfa5df3234768 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.312404 21780 tablet_replica.cc:330] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768: stopping tablet replica
I20260807 13:37:56.312870 21780 raft_consensus.cc:2229] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 13:37:56.313428 21780 raft_consensus.cc:2258] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P e3a48abf21bc4253ab8cfa5df3234768 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.315239 21780 tablet_replica.cc:330] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768: stopping tablet replica
I20260807 13:37:56.315800 21780 raft_consensus.cc:2229] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:37:56.316242 21780 raft_consensus.cc:2258] T 1ba53dccaae2468baf467e13e4ae3738 P e3a48abf21bc4253ab8cfa5df3234768 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.318116 21780 tablet_replica.cc:330] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768: stopping tablet replica
I20260807 13:37:56.318588 21780 raft_consensus.cc:2229] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [term 3 LEADER]: Raft consensus shutting down.
I20260807 13:37:56.319469 21780 raft_consensus.cc:2258] T 7fb75c03887d4004ba72504f437cd753 P e3a48abf21bc4253ab8cfa5df3234768 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.321199 21780 tablet_replica.cc:330] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768: stopping tablet replica
I20260807 13:37:56.321682 21780 raft_consensus.cc:2229] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [term 3 LEADER]: Raft consensus shutting down.
I20260807 13:37:56.322434 21780 raft_consensus.cc:2258] T af2dd6d4811f4b4b9586296ea6a8043e P e3a48abf21bc4253ab8cfa5df3234768 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.324218 21780 tablet_replica.cc:330] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768: stopping tablet replica
I20260807 13:37:56.324673 21780 raft_consensus.cc:2229] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768 [term 1 LEADER]: Raft consensus shutting down.
I20260807 13:37:56.325412 21780 raft_consensus.cc:2258] T 2030a14e8f0447fdbcaef7c340a1cbbd P e3a48abf21bc4253ab8cfa5df3234768 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.326998 21780 tablet_replica.cc:330] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768: stopping tablet replica
I20260807 13:37:56.327419 21780 raft_consensus.cc:2229] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:37:56.327870 21780 raft_consensus.cc:2258] T 01dc391e2ed6419c91dffb6033bd6abe P e3a48abf21bc4253ab8cfa5df3234768 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.329504 21780 tablet_replica.cc:330] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768: stopping tablet replica
I20260807 13:37:56.329936 21780 raft_consensus.cc:2229] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:37:56.330346 21780 raft_consensus.cc:2258] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P e3a48abf21bc4253ab8cfa5df3234768 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260807 13:37:56.334889 22124 consensus_peers.cc:487] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f -> Peer e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987): Couldn't send request to peer e3a48abf21bc4253ab8cfa5df3234768. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260807 13:37:56.338848 22124 consensus_peers.cc:487] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f -> Peer e3a48abf21bc4253ab8cfa5df3234768 (127.21.69.2:40987): Couldn't send request to peer e3a48abf21bc4253ab8cfa5df3234768. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260807 13:37:56.343302 22121 consensus_peers.cc:487] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f -> Peer 80268d1371f34a9383de934902767138 (127.21.69.1:36327): Couldn't send request to peer 80268d1371f34a9383de934902767138. Status: Network error: Client connection negotiation failed: client connection to 127.21.69.1:36327: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:37:56.363539 21780 tablet_server.cc:194] TabletServer@127.21.69.2:0 shutdown complete.
I20260807 13:37:56.382414 21780 tablet_server.cc:178] TabletServer@127.21.69.3:0 shutting down...
I20260807 13:37:56.416702 21780 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260807 13:37:56.417474 21780 tablet_replica.cc:330] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f: stopping tablet replica
I20260807 13:37:56.418144 21780 raft_consensus.cc:2229] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:37:56.418736 21780 raft_consensus.cc:2258] T 7fb75c03887d4004ba72504f437cd753 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.420740 21780 tablet_replica.cc:330] T 1ba53dccaae2468baf467e13e4ae3738 P b04c8a3c1c244a42a2eaf39b6cbd045f: stopping tablet replica
I20260807 13:37:56.421272 21780 raft_consensus.cc:2229] T 1ba53dccaae2468baf467e13e4ae3738 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:37:56.421774 21780 raft_consensus.cc:2258] T 1ba53dccaae2468baf467e13e4ae3738 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.423350 21780 tablet_replica.cc:330] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f: stopping tablet replica
I20260807 13:37:56.423942 21780 raft_consensus.cc:2229] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 4 LEADER]: Raft consensus shutting down.
I20260807 13:37:56.424739 21780 raft_consensus.cc:2258] T 94c992d4337f48318c5bf5cefae9aaad P b04c8a3c1c244a42a2eaf39b6cbd045f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.426376 21780 tablet_replica.cc:330] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f: stopping tablet replica
I20260807 13:37:56.426939 21780 raft_consensus.cc:2229] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 LEADER]: Raft consensus shutting down.
I20260807 13:37:56.427850 21780 raft_consensus.cc:2258] T 01dc391e2ed6419c91dffb6033bd6abe P b04c8a3c1c244a42a2eaf39b6cbd045f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.429618 21780 tablet_replica.cc:330] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f: stopping tablet replica
I20260807 13:37:56.430110 21780 raft_consensus.cc:2229] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:37:56.430567 21780 raft_consensus.cc:2258] T 7cc45a0c9f0e4f7fb44e5cdf41d038ee P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.432323 21780 tablet_replica.cc:330] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f: stopping tablet replica
I20260807 13:37:56.432830 21780 raft_consensus.cc:2229] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 13:37:56.433256 21780 raft_consensus.cc:2258] T bdd8f5d33fb34ce6a5f5dd56f5a4846d P b04c8a3c1c244a42a2eaf39b6cbd045f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.435021 21780 tablet_replica.cc:330] T af2dd6d4811f4b4b9586296ea6a8043e P b04c8a3c1c244a42a2eaf39b6cbd045f: stopping tablet replica
I20260807 13:37:56.435508 21780 raft_consensus.cc:2229] T af2dd6d4811f4b4b9586296ea6a8043e P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:37:56.436000 21780 raft_consensus.cc:2258] T af2dd6d4811f4b4b9586296ea6a8043e P b04c8a3c1c244a42a2eaf39b6cbd045f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.437616 21780 tablet_replica.cc:330] T 2030a14e8f0447fdbcaef7c340a1cbbd P b04c8a3c1c244a42a2eaf39b6cbd045f: stopping tablet replica
I20260807 13:37:56.438081 21780 raft_consensus.cc:2229] T 2030a14e8f0447fdbcaef7c340a1cbbd P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:37:56.438477 21780 raft_consensus.cc:2258] T 2030a14e8f0447fdbcaef7c340a1cbbd P b04c8a3c1c244a42a2eaf39b6cbd045f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.440127 21780 tablet_replica.cc:330] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f: stopping tablet replica
I20260807 13:37:56.440594 21780 raft_consensus.cc:2229] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 4 LEADER]: Raft consensus shutting down.
I20260807 13:37:56.441411 21780 raft_consensus.cc:2258] T 7026bb7599934e0799edcd002a653f67 P b04c8a3c1c244a42a2eaf39b6cbd045f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.469671 21780 tablet_server.cc:194] TabletServer@127.21.69.3:0 shutdown complete.
I20260807 13:37:56.488613 21780 master.cc:537] Master@127.21.69.62:40701 shutting down...
I20260807 13:37:56.536664 21905 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Closing
I20260807 13:37:56.761032 21780 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0 [term 1 LEADER]: Raft consensus shutting down.
I20260807 13:37:56.761713 21780 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:37:56.762091 21780 tablet_replica.cc:330] T 00000000000000000000000000000000 P 985a55ae51484de5866293aa5c836ae0: stopping tablet replica
I20260807 13:37:56.781428 21780 master.cc:552] Master@127.21.69.62:40701 shutdown complete.
80268d1371f34a9383de934902767138 4
b04c8a3c1c244a42a2eaf39b6cbd045f 1
e3a48abf21bc4253ab8cfa5df3234768 4
80268d1371f34a9383de934902767138 3
b04c8a3c1c244a42a2eaf39b6cbd045f 3
e3a48abf21bc4253ab8cfa5df3234768 3
80268d1371f34a9383de934902767138 0
b04c8a3c1c244a42a2eaf39b6cbd045f 1
e3a48abf21bc4253ab8cfa5df3234768 8
80268d1371f34a9383de934902767138 3
b04c8a3c1c244a42a2eaf39b6cbd045f 3
e3a48abf21bc4253ab8cfa5df3234768 3
[ OK ] LeaderRebalancerTest.FunctionalTestForDivided (32114 ms)
[ RUN ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260807 13:37:56.831264 21780 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.21.69.62:34023
I20260807 13:37:56.832645 21780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:37:56.839496 22559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:37:56.840046 22557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:37:56.840057 22561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:37:56.841508 21780 server_base.cc:1034] running on GCE node
I20260807 13:37:56.842657 21780 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:37:56.842892 21780 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:37:56.843061 21780 hybrid_clock.cc:648] HybridClock initialized: now 1786109876843045 us; error 0 us; skew 500 ppm
I20260807 13:37:56.843617 21780 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:37:56.850108 21780 webserver.cc:460] Webserver started at http://127.21.69.62:43327/ using document root <none> and password file <none>
I20260807 13:37:56.850721 21780 fs_manager.cc:359] Metadata directory not provided
I20260807 13:37:56.850944 21780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:37:56.851253 21780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:37:56.852631 21780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109844500879-21780-0/minicluster-data/master-0-root/instance:
uuid: "4a3a89d411ec4c0bb0a327aeee839afc"
format_stamp: "Formatted at 2026-08-07 13:37:56 on dist-test-slave-mjjr"
I20260807 13:37:56.857920 21780 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260807 13:37:56.861646 22568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:37:56.862615 21780 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 13:37:56.862943 21780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109844500879-21780-0/minicluster-data/master-0-root
uuid: "4a3a89d411ec4c0bb0a327aeee839afc"
format_stamp: "Formatted at 2026-08-07 13:37:56 on dist-test-slave-mjjr"
I20260807 13:37:56.863224 21780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109844500879-21780-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109844500879-21780-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109844500879-21780-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:37:56.876510 21780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:37:56.877857 21780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:37:56.921042 21780 rpc_server.cc:307] RPC server started. Bound to: 127.21.69.62:34023
I20260807 13:37:56.921147 22640 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.69.62:34023 every 8 connection(s)
I20260807 13:37:56.925150 22641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:56.935513 22641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a3a89d411ec4c0bb0a327aeee839afc: Bootstrap starting.
I20260807 13:37:56.940282 22641 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a3a89d411ec4c0bb0a327aeee839afc: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:56.945179 22641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a3a89d411ec4c0bb0a327aeee839afc: No bootstrap required, opened a new log
I20260807 13:37:56.947412 22641 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4a3a89d411ec4c0bb0a327aeee839afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a3a89d411ec4c0bb0a327aeee839afc" member_type: VOTER }
I20260807 13:37:56.947983 22641 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4a3a89d411ec4c0bb0a327aeee839afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:56.948227 22641 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4a3a89d411ec4c0bb0a327aeee839afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a3a89d411ec4c0bb0a327aeee839afc, State: Initialized, Role: FOLLOWER
I20260807 13:37:56.948904 22641 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a3a89d411ec4c0bb0a327aeee839afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a3a89d411ec4c0bb0a327aeee839afc" member_type: VOTER }
I20260807 13:37:56.949391 22641 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4a3a89d411ec4c0bb0a327aeee839afc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 13:37:56.949661 22641 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4a3a89d411ec4c0bb0a327aeee839afc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 13:37:56.949965 22641 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4a3a89d411ec4c0bb0a327aeee839afc [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:56.954267 22641 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4a3a89d411ec4c0bb0a327aeee839afc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a3a89d411ec4c0bb0a327aeee839afc" member_type: VOTER }
I20260807 13:37:56.954896 22641 leader_election.cc:302] T 00000000000000000000000000000000 P 4a3a89d411ec4c0bb0a327aeee839afc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4a3a89d411ec4c0bb0a327aeee839afc; no voters:
I20260807 13:37:56.956199 22641 leader_election.cc:288] T 00000000000000000000000000000000 P 4a3a89d411ec4c0bb0a327aeee839afc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 13:37:56.956622 22645 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4a3a89d411ec4c0bb0a327aeee839afc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:37:56.958103 22645 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4a3a89d411ec4c0bb0a327aeee839afc [term 1 LEADER]: Becoming Leader. State: Replica: 4a3a89d411ec4c0bb0a327aeee839afc, State: Running, Role: LEADER
I20260807 13:37:56.958894 22645 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4a3a89d411ec4c0bb0a327aeee839afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a3a89d411ec4c0bb0a327aeee839afc" member_type: VOTER }
I20260807 13:37:56.959599 22641 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4a3a89d411ec4c0bb0a327aeee839afc [sys.catalog]: configured and running, proceeding with master startup.
I20260807 13:37:56.964275 22646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a3a89d411ec4c0bb0a327aeee839afc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4a3a89d411ec4c0bb0a327aeee839afc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a3a89d411ec4c0bb0a327aeee839afc" member_type: VOTER } }
I20260807 13:37:56.965200 22646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a3a89d411ec4c0bb0a327aeee839afc [sys.catalog]: This master's current role is: LEADER
I20260807 13:37:56.965107 22647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a3a89d411ec4c0bb0a327aeee839afc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a3a89d411ec4c0bb0a327aeee839afc. Latest consensus state: current_term: 1 leader_uuid: "4a3a89d411ec4c0bb0a327aeee839afc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a3a89d411ec4c0bb0a327aeee839afc" member_type: VOTER } }
I20260807 13:37:56.965965 22647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a3a89d411ec4c0bb0a327aeee839afc [sys.catalog]: This master's current role is: LEADER
I20260807 13:37:56.968568 22652 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 13:37:56.974015 22652 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 13:37:56.979481 21780 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260807 13:37:56.983786 22652 catalog_manager.cc:1347] Generated new cluster ID: 11f83d8f0284485bad63a558544e6c4c
I20260807 13:37:56.984107 22652 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 13:37:57.009727 22652 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 13:37:57.011472 22652 catalog_manager.cc:1504] Loading token signing keys...
I20260807 13:37:57.026759 22652 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4a3a89d411ec4c0bb0a327aeee839afc: Generated new TSK 0
I20260807 13:37:57.027465 22652 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 13:37:57.047561 21780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:37:57.054176 22664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:37:57.055452 22665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:37:57.057220 22667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:37:57.058013 21780 server_base.cc:1034] running on GCE node
I20260807 13:37:57.059263 21780 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:37:57.059458 21780 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:37:57.059725 21780 hybrid_clock.cc:648] HybridClock initialized: now 1786109877059704 us; error 0 us; skew 500 ppm
I20260807 13:37:57.060335 21780 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:37:57.062916 21780 webserver.cc:460] Webserver started at http://127.21.69.1:38015/ using document root <none> and password file <none>
I20260807 13:37:57.063484 21780 fs_manager.cc:359] Metadata directory not provided
I20260807 13:37:57.063716 21780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:37:57.064023 21780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:37:57.065229 21780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109844500879-21780-0/minicluster-data/ts-0-root/instance:
uuid: "372a4f85197e454ca7320876e3b7c4fc"
format_stamp: "Formatted at 2026-08-07 13:37:57 on dist-test-slave-mjjr"
I20260807 13:37:57.070523 21780 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 13:37:57.074575 22674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:37:57.075426 21780 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 13:37:57.075848 21780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109844500879-21780-0/minicluster-data/ts-0-root
uuid: "372a4f85197e454ca7320876e3b7c4fc"
format_stamp: "Formatted at 2026-08-07 13:37:57 on dist-test-slave-mjjr"
I20260807 13:37:57.076201 21780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109844500879-21780-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109844500879-21780-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109844500879-21780-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:37:57.107354 21780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:37:57.108788 21780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:37:57.110337 21780 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:37:57.112846 21780 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:37:57.113097 21780 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:37:57.113359 21780 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:37:57.113554 21780 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:37:57.182583 21780 rpc_server.cc:307] RPC server started. Bound to: 127.21.69.1:33643
I20260807 13:37:57.182749 22758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.69.1:33643 every 8 connection(s)
I20260807 13:37:57.188097 21780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:37:57.197110 22763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:37:57.197641 22767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:37:57.207628 21780 server_base.cc:1034] running on GCE node
W20260807 13:37:57.208627 22772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:37:57.209769 22759 heartbeater.cc:347] Connected to a master server at 127.21.69.62:34023
I20260807 13:37:57.209846 21780 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:37:57.210227 21780 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:37:57.210278 22759 heartbeater.cc:464] Registering TS with master...
I20260807 13:37:57.210464 21780 hybrid_clock.cc:648] HybridClock initialized: now 1786109877210419 us; error 0 us; skew 500 ppm
I20260807 13:37:57.211165 21780 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:37:57.211170 22759 heartbeater.cc:511] Master 127.21.69.62:34023 requested a full tablet report, sending...
I20260807 13:37:57.214054 22591 ts_manager.cc:194] Registered new tserver with Master: 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643)
I20260807 13:37:57.214282 21780 webserver.cc:460] Webserver started at http://127.21.69.2:43533/ using document root <none> and password file <none>
I20260807 13:37:57.215260 21780 fs_manager.cc:359] Metadata directory not provided
I20260807 13:37:57.215541 21780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:37:57.216030 21780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:37:57.216619 22591 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41554
I20260807 13:37:57.217754 21780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109844500879-21780-0/minicluster-data/ts-1-root/instance:
uuid: "7816d0098bcf407f8a4db491fc5b1765"
format_stamp: "Formatted at 2026-08-07 13:37:57 on dist-test-slave-mjjr"
I20260807 13:37:57.222887 21780 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 13:37:57.226765 22779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:37:57.227630 21780 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 13:37:57.228168 21780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109844500879-21780-0/minicluster-data/ts-1-root
uuid: "7816d0098bcf407f8a4db491fc5b1765"
format_stamp: "Formatted at 2026-08-07 13:37:57 on dist-test-slave-mjjr"
I20260807 13:37:57.228484 21780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109844500879-21780-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109844500879-21780-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109844500879-21780-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:37:57.243355 21780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:37:57.244829 21780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:37:57.246390 21780 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:37:57.248828 21780 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:37:57.249017 21780 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:37:57.249302 21780 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:37:57.249465 21780 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:37:57.294116 21780 rpc_server.cc:307] RPC server started. Bound to: 127.21.69.2:44001
I20260807 13:37:57.294224 22860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.69.2:44001 every 8 connection(s)
I20260807 13:37:57.299507 21780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:37:57.308604 22865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:37:57.310372 22866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:37:57.314965 21780 server_base.cc:1034] running on GCE node
W20260807 13:37:57.315622 22869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:37:57.316458 22862 heartbeater.cc:347] Connected to a master server at 127.21.69.62:34023
I20260807 13:37:57.317041 22862 heartbeater.cc:464] Registering TS with master...
I20260807 13:37:57.317075 21780 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:37:57.317437 21780 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:37:57.317643 21780 hybrid_clock.cc:648] HybridClock initialized: now 1786109877317627 us; error 0 us; skew 500 ppm
I20260807 13:37:57.318107 22862 heartbeater.cc:511] Master 127.21.69.62:34023 requested a full tablet report, sending...
I20260807 13:37:57.318439 21780 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:37:57.320668 22591 ts_manager.cc:194] Registered new tserver with Master: 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001)
I20260807 13:37:57.322372 22591 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41570
I20260807 13:37:57.324455 21780 webserver.cc:460] Webserver started at http://127.21.69.3:41233/ using document root <none> and password file <none>
I20260807 13:37:57.325071 21780 fs_manager.cc:359] Metadata directory not provided
I20260807 13:37:57.325309 21780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:37:57.325618 21780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:37:57.326911 21780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109844500879-21780-0/minicluster-data/ts-2-root/instance:
uuid: "f1b6231195f34d7288d834af49866850"
format_stamp: "Formatted at 2026-08-07 13:37:57 on dist-test-slave-mjjr"
I20260807 13:37:57.332732 21780 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260807 13:37:57.336719 22876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:37:57.337870 21780 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 13:37:57.338335 21780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109844500879-21780-0/minicluster-data/ts-2-root
uuid: "f1b6231195f34d7288d834af49866850"
format_stamp: "Formatted at 2026-08-07 13:37:57 on dist-test-slave-mjjr"
I20260807 13:37:57.338824 21780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109844500879-21780-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109844500879-21780-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109844500879-21780-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:37:57.349671 21780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:37:57.350986 21780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:37:57.352619 21780 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:37:57.355202 21780 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:37:57.355479 21780 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:37:57.355795 21780 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:37:57.355986 21780 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:37:57.401338 21780 rpc_server.cc:307] RPC server started. Bound to: 127.21.69.3:41343
I20260807 13:37:57.401471 22963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.69.3:41343 every 8 connection(s)
I20260807 13:37:57.418111 22964 heartbeater.cc:347] Connected to a master server at 127.21.69.62:34023
I20260807 13:37:57.418571 22964 heartbeater.cc:464] Registering TS with master...
I20260807 13:37:57.419266 22964 heartbeater.cc:511] Master 127.21.69.62:34023 requested a full tablet report, sending...
I20260807 13:37:57.421267 22591 ts_manager.cc:194] Registered new tserver with Master: f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:57.422170 21780 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017289314s
I20260807 13:37:57.422971 22591 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41578
I20260807 13:37:57.424841 21780 test_util.cc:268] Using random seed: 482742960
I20260807 13:37:57.453516 22591 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41584:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 13:37:57.456663 22591 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 13:37:57.585990 22918 tablet_service.cc:1467] Processing CreateTablet for tablet 582d348a46de4d7c9ca05897b09e863f (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260807 13:37:57.586450 22917 tablet_service.cc:1467] Processing CreateTablet for tablet 4d1061583ccc4c4eb3f54133ec30ebbb (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260807 13:37:57.587698 22918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 582d348a46de4d7c9ca05897b09e863f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.588395 22917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d1061583ccc4c4eb3f54133ec30ebbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.588124 22912 tablet_service.cc:1467] Processing CreateTablet for tablet 792691555ea442f39ad0f98f9a406618 (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260807 13:37:57.588817 22916 tablet_service.cc:1467] Processing CreateTablet for tablet 292b176c9c8c46d1b74684303c1c9d58 (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260807 13:37:57.589570 22912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 792691555ea442f39ad0f98f9a406618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.590101 22911 tablet_service.cc:1467] Processing CreateTablet for tablet 8078e36e4510492cb458f7f9ec29a87a (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260807 13:37:57.591502 22911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8078e36e4510492cb458f7f9ec29a87a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.591264 22915 tablet_service.cc:1467] Processing CreateTablet for tablet a624e082005541a4b54ff5b7a4dd025e (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260807 13:37:57.592752 22915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a624e082005541a4b54ff5b7a4dd025e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.597051 22913 tablet_service.cc:1467] Processing CreateTablet for tablet eeb3496f0d6c4e8abf2c74435aab93b1 (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260807 13:37:57.598657 22913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeb3496f0d6c4e8abf2c74435aab93b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.600066 22916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 292b176c9c8c46d1b74684303c1c9d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.605178 22909 tablet_service.cc:1467] Processing CreateTablet for tablet 7c6d56e133e448138b6424f52ae64c02 (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260807 13:37:57.607288 22909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c6d56e133e448138b6424f52ae64c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.613226 22907 tablet_service.cc:1467] Processing CreateTablet for tablet a9540fdebd564c91937a94648f5f07a5 (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260807 13:37:57.614972 22907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9540fdebd564c91937a94648f5f07a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.622485 22715 tablet_service.cc:1467] Processing CreateTablet for tablet 582d348a46de4d7c9ca05897b09e863f (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260807 13:37:57.625367 22714 tablet_service.cc:1467] Processing CreateTablet for tablet 4d1061583ccc4c4eb3f54133ec30ebbb (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260807 13:37:57.628408 22709 tablet_service.cc:1467] Processing CreateTablet for tablet eeb3496f0d6c4e8abf2c74435aab93b1 (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260807 13:37:57.628634 22705 tablet_service.cc:1467] Processing CreateTablet for tablet 8078e36e4510492cb458f7f9ec29a87a (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260807 13:37:57.630510 22715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 582d348a46de4d7c9ca05897b09e863f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.630769 22711 tablet_service.cc:1467] Processing CreateTablet for tablet a624e082005541a4b54ff5b7a4dd025e (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260807 13:37:57.633033 22706 tablet_service.cc:1467] Processing CreateTablet for tablet 792691555ea442f39ad0f98f9a406618 (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260807 13:37:57.635275 22713 tablet_service.cc:1467] Processing CreateTablet for tablet 292b176c9c8c46d1b74684303c1c9d58 (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260807 13:37:57.637024 22711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a624e082005541a4b54ff5b7a4dd025e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.640885 22817 tablet_service.cc:1467] Processing CreateTablet for tablet 582d348a46de4d7c9ca05897b09e863f (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260807 13:37:57.642388 22817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 582d348a46de4d7c9ca05897b09e863f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.645058 22816 tablet_service.cc:1467] Processing CreateTablet for tablet 4d1061583ccc4c4eb3f54133ec30ebbb (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260807 13:37:57.645535 22704 tablet_service.cc:1467] Processing CreateTablet for tablet 7c6d56e133e448138b6424f52ae64c02 (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260807 13:37:57.646646 22816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d1061583ccc4c4eb3f54133ec30ebbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.647030 22704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c6d56e133e448138b6424f52ae64c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.652760 22814 tablet_service.cc:1467] Processing CreateTablet for tablet a624e082005541a4b54ff5b7a4dd025e (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260807 13:37:57.656556 22813 tablet_service.cc:1467] Processing CreateTablet for tablet eeb3496f0d6c4e8abf2c74435aab93b1 (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260807 13:37:57.657445 22807 tablet_service.cc:1467] Processing CreateTablet for tablet a9540fdebd564c91937a94648f5f07a5 (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260807 13:37:57.659407 22811 tablet_service.cc:1467] Processing CreateTablet for tablet 792691555ea442f39ad0f98f9a406618 (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260807 13:37:57.660228 22807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9540fdebd564c91937a94648f5f07a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.661013 22811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 792691555ea442f39ad0f98f9a406618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.665025 22814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a624e082005541a4b54ff5b7a4dd025e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.638753 22815 tablet_service.cc:1467] Processing CreateTablet for tablet 292b176c9c8c46d1b74684303c1c9d58 (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260807 13:37:57.680953 22987 tablet_bootstrap.cc:492] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850: Bootstrap starting.
I20260807 13:37:57.683617 22917 tablet_service.cc:1467] Processing CreateTablet for tablet 7f2c02047eb84ad58db0a4e061758163 (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260807 13:37:57.685287 22917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f2c02047eb84ad58db0a4e061758163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.691951 22709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeb3496f0d6c4e8abf2c74435aab93b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.701097 22987 tablet_bootstrap.cc:654] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:57.717195 22990 tablet_bootstrap.cc:492] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc: Bootstrap starting.
I20260807 13:37:57.720947 22702 tablet_service.cc:1467] Processing CreateTablet for tablet a9540fdebd564c91937a94648f5f07a5 (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260807 13:37:57.722963 22702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9540fdebd564c91937a94648f5f07a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.723203 22990 tablet_bootstrap.cc:654] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:57.751503 22699 tablet_service.cc:1467] Processing CreateTablet for tablet 7f2c02047eb84ad58db0a4e061758163 (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260807 13:37:57.753095 22699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f2c02047eb84ad58db0a4e061758163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.755865 22993 tablet_bootstrap.cc:492] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765: Bootstrap starting.
I20260807 13:37:57.758874 22990 tablet_bootstrap.cc:492] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc: No bootstrap required, opened a new log
I20260807 13:37:57.759473 22990 ts_tablet_manager.cc:1397] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc: Time spent bootstrapping tablet: real 0.043s user 0.016s sys 0.017s
I20260807 13:37:57.762753 22990 raft_consensus.cc:348] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:57.763690 22993 tablet_bootstrap.cc:654] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:57.763610 22990 raft_consensus.cc:374] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:57.764205 22990 raft_consensus.cc:729] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Initialized, Role: FOLLOWER
I20260807 13:37:57.765177 22990 consensus_queue.cc:260] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:57.769893 22987 tablet_bootstrap.cc:492] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850: No bootstrap required, opened a new log
I20260807 13:37:57.770438 22987 ts_tablet_manager.cc:1397] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850: Time spent bootstrapping tablet: real 0.090s user 0.011s sys 0.025s
I20260807 13:37:57.770601 22990 ts_tablet_manager.cc:1428] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc: Time spent starting tablet: real 0.011s user 0.004s sys 0.004s
I20260807 13:37:57.771457 22759 heartbeater.cc:503] Master 127.21.69.62:34023 was elected leader, sending a full tablet report...
I20260807 13:37:57.774097 22990 tablet_bootstrap.cc:492] T a9540fdebd564c91937a94648f5f07a5 P 372a4f85197e454ca7320876e3b7c4fc: Bootstrap starting.
I20260807 13:37:57.781595 22990 tablet_bootstrap.cc:654] T a9540fdebd564c91937a94648f5f07a5 P 372a4f85197e454ca7320876e3b7c4fc: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:57.787151 22987 raft_consensus.cc:348] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:57.788326 22987 raft_consensus.cc:374] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:57.788714 22987 raft_consensus.cc:729] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1b6231195f34d7288d834af49866850, State: Initialized, Role: FOLLOWER
I20260807 13:37:57.789728 22987 consensus_queue.cc:260] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:57.794278 22815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 292b176c9c8c46d1b74684303c1c9d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.794796 22993 tablet_bootstrap.cc:492] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765: No bootstrap required, opened a new log
I20260807 13:37:57.795492 22993 ts_tablet_manager.cc:1397] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765: Time spent bootstrapping tablet: real 0.041s user 0.008s sys 0.004s
I20260807 13:37:57.799610 22993 raft_consensus.cc:348] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:57.800817 22993 raft_consensus.cc:374] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:57.801255 22993 raft_consensus.cc:729] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7816d0098bcf407f8a4db491fc5b1765, State: Initialized, Role: FOLLOWER
I20260807 13:37:57.802392 22993 consensus_queue.cc:260] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:57.807194 22987 ts_tablet_manager.cc:1428] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850: Time spent starting tablet: real 0.036s user 0.007s sys 0.003s
I20260807 13:37:57.808785 22987 tablet_bootstrap.cc:492] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850: Bootstrap starting.
I20260807 13:37:57.817485 22993 ts_tablet_manager.cc:1428] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765: Time spent starting tablet: real 0.022s user 0.008s sys 0.001s
I20260807 13:37:57.819034 22993 tablet_bootstrap.cc:492] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765: Bootstrap starting.
I20260807 13:37:57.822273 22990 tablet_bootstrap.cc:492] T a9540fdebd564c91937a94648f5f07a5 P 372a4f85197e454ca7320876e3b7c4fc: No bootstrap required, opened a new log
I20260807 13:37:57.822907 22990 ts_tablet_manager.cc:1397] T a9540fdebd564c91937a94648f5f07a5 P 372a4f85197e454ca7320876e3b7c4fc: Time spent bootstrapping tablet: real 0.049s user 0.012s sys 0.033s
I20260807 13:37:57.825662 22993 tablet_bootstrap.cc:654] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:57.808789 22713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 292b176c9c8c46d1b74684303c1c9d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.825987 22990 raft_consensus.cc:348] T a9540fdebd564c91937a94648f5f07a5 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:57.828047 22990 raft_consensus.cc:374] T a9540fdebd564c91937a94648f5f07a5 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:57.828415 22990 raft_consensus.cc:729] T a9540fdebd564c91937a94648f5f07a5 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Initialized, Role: FOLLOWER
I20260807 13:37:57.829372 22990 consensus_queue.cc:260] T a9540fdebd564c91937a94648f5f07a5 P 372a4f85197e454ca7320876e3b7c4fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:57.831367 22987 tablet_bootstrap.cc:654] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:57.831995 22990 ts_tablet_manager.cc:1428] T a9540fdebd564c91937a94648f5f07a5 P 372a4f85197e454ca7320876e3b7c4fc: Time spent starting tablet: real 0.009s user 0.002s sys 0.008s
I20260807 13:37:57.833083 22990 tablet_bootstrap.cc:492] T 7f2c02047eb84ad58db0a4e061758163 P 372a4f85197e454ca7320876e3b7c4fc: Bootstrap starting.
I20260807 13:37:57.839879 22990 tablet_bootstrap.cc:654] T 7f2c02047eb84ad58db0a4e061758163 P 372a4f85197e454ca7320876e3b7c4fc: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:57.839967 22808 tablet_service.cc:1467] Processing CreateTablet for tablet 7c6d56e133e448138b6424f52ae64c02 (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260807 13:37:57.841656 22808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c6d56e133e448138b6424f52ae64c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.843511 22987 tablet_bootstrap.cc:492] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850: No bootstrap required, opened a new log
I20260807 13:37:57.844100 22987 ts_tablet_manager.cc:1397] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850: Time spent bootstrapping tablet: real 0.036s user 0.015s sys 0.001s
I20260807 13:37:57.850795 22995 raft_consensus.cc:482] T a9540fdebd564c91937a94648f5f07a5 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:57.851430 22995 raft_consensus.cc:504] T a9540fdebd564c91937a94648f5f07a5 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:57.853821 22862 heartbeater.cc:503] Master 127.21.69.62:34023 was elected leader, sending a full tablet report...
I20260807 13:37:57.854461 22990 tablet_bootstrap.cc:492] T 7f2c02047eb84ad58db0a4e061758163 P 372a4f85197e454ca7320876e3b7c4fc: No bootstrap required, opened a new log
I20260807 13:37:57.855080 22990 ts_tablet_manager.cc:1397] T 7f2c02047eb84ad58db0a4e061758163 P 372a4f85197e454ca7320876e3b7c4fc: Time spent bootstrapping tablet: real 0.022s user 0.012s sys 0.008s
I20260807 13:37:57.856182 22995 leader_election.cc:288] T a9540fdebd564c91937a94648f5f07a5 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:57.858398 22990 raft_consensus.cc:348] T 7f2c02047eb84ad58db0a4e061758163 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:57.859372 22990 raft_consensus.cc:374] T 7f2c02047eb84ad58db0a4e061758163 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:57.859778 22990 raft_consensus.cc:729] T 7f2c02047eb84ad58db0a4e061758163 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Initialized, Role: FOLLOWER
I20260807 13:37:57.860749 22990 consensus_queue.cc:260] T 7f2c02047eb84ad58db0a4e061758163 P 372a4f85197e454ca7320876e3b7c4fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:57.863376 22990 ts_tablet_manager.cc:1428] T 7f2c02047eb84ad58db0a4e061758163 P 372a4f85197e454ca7320876e3b7c4fc: Time spent starting tablet: real 0.008s user 0.003s sys 0.003s
I20260807 13:37:57.865633 22990 tablet_bootstrap.cc:492] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc: Bootstrap starting.
I20260807 13:37:57.667006 22810 tablet_service.cc:1467] Processing CreateTablet for tablet 8078e36e4510492cb458f7f9ec29a87a (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260807 13:37:57.872725 22990 tablet_bootstrap.cc:654] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:57.871562 22810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8078e36e4510492cb458f7f9ec29a87a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.847141 22987 raft_consensus.cc:348] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:57.881673 22993 tablet_bootstrap.cc:492] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765: No bootstrap required, opened a new log
I20260807 13:37:57.895795 22993 ts_tablet_manager.cc:1397] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765: Time spent bootstrapping tablet: real 0.077s user 0.016s sys 0.004s
I20260807 13:37:57.900614 22999 raft_consensus.cc:482] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:57.901222 22999 raft_consensus.cc:504] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:57.903318 22999 leader_election.cc:288] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001)
I20260807 13:37:57.904265 23001 raft_consensus.cc:482] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:57.904788 23001 raft_consensus.cc:504] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:57.907341 23001 leader_election.cc:288] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:57.884406 22987 raft_consensus.cc:374] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:57.908968 22987 raft_consensus.cc:729] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1b6231195f34d7288d834af49866850, State: Initialized, Role: FOLLOWER
I20260807 13:37:57.910223 22987 consensus_queue.cc:260] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:57.911336 22813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeb3496f0d6c4e8abf2c74435aab93b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.913247 22987 ts_tablet_manager.cc:1428] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850: Time spent starting tablet: real 0.069s user 0.007s sys 0.001s
I20260807 13:37:57.914551 22987 tablet_bootstrap.cc:492] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850: Bootstrap starting.
I20260807 13:37:57.918510 22714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d1061583ccc4c4eb3f54133ec30ebbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.908041 22993 raft_consensus.cc:348] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:57.924293 22993 raft_consensus.cc:374] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:57.924655 22993 raft_consensus.cc:729] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7816d0098bcf407f8a4db491fc5b1765, State: Initialized, Role: FOLLOWER
I20260807 13:37:57.924995 22706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 792691555ea442f39ad0f98f9a406618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.925366 22993 consensus_queue.cc:260] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:57.934399 22993 ts_tablet_manager.cc:1428] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765: Time spent starting tablet: real 0.031s user 0.005s sys 0.000s
I20260807 13:37:57.944089 22990 tablet_bootstrap.cc:492] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc: No bootstrap required, opened a new log
I20260807 13:37:57.947813 22990 ts_tablet_manager.cc:1397] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc: Time spent bootstrapping tablet: real 0.083s user 0.016s sys 0.002s
I20260807 13:37:57.951701 22964 heartbeater.cc:503] Master 127.21.69.62:34023 was elected leader, sending a full tablet report...
I20260807 13:37:57.955664 22806 tablet_service.cc:1467] Processing CreateTablet for tablet 7f2c02047eb84ad58db0a4e061758163 (DEFAULT_TABLE table=test-workload [id=436304c83a794e59a35685e44e30ea38]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260807 13:37:57.957010 22806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f2c02047eb84ad58db0a4e061758163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.975329 22990 raft_consensus.cc:348] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:57.976334 22990 raft_consensus.cc:374] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:57.976737 22990 raft_consensus.cc:729] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Initialized, Role: FOLLOWER
I20260807 13:37:57.977751 22990 consensus_queue.cc:260] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:57.980657 22990 ts_tablet_manager.cc:1428] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc: Time spent starting tablet: real 0.032s user 0.007s sys 0.000s
I20260807 13:37:57.981694 22990 tablet_bootstrap.cc:492] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc: Bootstrap starting.
W20260807 13:37:57.985085 22656 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:37:57.989909 22993 tablet_bootstrap.cc:492] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765: Bootstrap starting.
I20260807 13:37:57.996043 22705 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8078e36e4510492cb458f7f9ec29a87a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:37:57.999137 22828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "792691555ea442f39ad0f98f9a406618" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7816d0098bcf407f8a4db491fc5b1765" is_pre_election: true
I20260807 13:37:58.000099 22828 raft_consensus.cc:2454] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1b6231195f34d7288d834af49866850 in term 0.
I20260807 13:37:58.002316 22878 leader_election.cc:302] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7816d0098bcf407f8a4db491fc5b1765, f1b6231195f34d7288d834af49866850; no voters:
I20260807 13:37:58.003234 22999 raft_consensus.cc:2781] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:37:58.003582 22999 raft_consensus.cc:482] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:37:58.003943 22999 raft_consensus.cc:3037] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.024466 22987 tablet_bootstrap.cc:654] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:58.031957 22999 raft_consensus.cc:504] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.060832 22999 leader_election.cc:288] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 election: Requested vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001)
I20260807 13:37:58.061476 22999 raft_consensus.cc:482] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:58.061978 22999 raft_consensus.cc:504] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.067567 22828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "792691555ea442f39ad0f98f9a406618" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
I20260807 13:37:58.068066 22995 raft_consensus.cc:482] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:58.068344 22828 raft_consensus.cc:3037] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.068773 22995 raft_consensus.cc:504] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.076165 22726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d1061583ccc4c4eb3f54133ec30ebbb" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372a4f85197e454ca7320876e3b7c4fc" is_pre_election: true
W20260807 13:37:58.078064 22780 leader_election.cc:341] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:58.079242 22990 tablet_bootstrap.cc:654] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:58.082021 22995 leader_election.cc:288] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:58.089568 22827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d1061583ccc4c4eb3f54133ec30ebbb" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7816d0098bcf407f8a4db491fc5b1765" is_pre_election: true
I20260807 13:37:58.090390 22827 raft_consensus.cc:2454] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1b6231195f34d7288d834af49866850 in term 0.
I20260807 13:37:58.091869 22878 leader_election.cc:302] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7816d0098bcf407f8a4db491fc5b1765, f1b6231195f34d7288d834af49866850; no voters:
I20260807 13:37:58.090394 22999 leader_election.cc:288] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001)
I20260807 13:37:58.093259 22999 raft_consensus.cc:2781] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:37:58.093636 22999 raft_consensus.cc:482] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:37:58.093981 22999 raft_consensus.cc:3037] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.095114 22828 raft_consensus.cc:2454] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b6231195f34d7288d834af49866850 in term 1.
I20260807 13:37:58.076517 22993 tablet_bootstrap.cc:654] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:58.101042 22878 leader_election.cc:302] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7816d0098bcf407f8a4db491fc5b1765, f1b6231195f34d7288d834af49866850; no voters:
I20260807 13:37:58.107546 22987 tablet_bootstrap.cc:492] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850: No bootstrap required, opened a new log
I20260807 13:37:58.108196 22987 ts_tablet_manager.cc:1397] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850: Time spent bootstrapping tablet: real 0.194s user 0.016s sys 0.013s
I20260807 13:37:58.111467 22726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "792691555ea442f39ad0f98f9a406618" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372a4f85197e454ca7320876e3b7c4fc" is_pre_election: true
I20260807 13:37:58.112825 22725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "792691555ea442f39ad0f98f9a406618" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
I20260807 13:37:58.114194 22724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d1061583ccc4c4eb3f54133ec30ebbb" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372a4f85197e454ca7320876e3b7c4fc" is_pre_election: true
I20260807 13:37:58.111163 22987 raft_consensus.cc:348] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } }
I20260807 13:37:58.116132 22987 raft_consensus.cc:374] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:58.116542 22987 raft_consensus.cc:729] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1b6231195f34d7288d834af49866850, State: Initialized, Role: FOLLOWER
W20260807 13:37:58.116869 22877 leader_election.cc:341] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:58.116950 22931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d1061583ccc4c4eb3f54133ec30ebbb" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b6231195f34d7288d834af49866850" is_pre_election: true
W20260807 13:37:58.117942 22877 leader_election.cc:341] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:58.117522 22987 consensus_queue.cc:260] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } }
W20260807 13:37:58.119269 22877 leader_election.cc:341] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:58.120397 22828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9540fdebd564c91937a94648f5f07a5" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7816d0098bcf407f8a4db491fc5b1765" is_pre_election: true
I20260807 13:37:58.121707 23019 raft_consensus.cc:2781] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:37:58.122131 22828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a624e082005541a4b54ff5b7a4dd025e" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7816d0098bcf407f8a4db491fc5b1765" is_pre_election: true
W20260807 13:37:58.123090 22676 leader_election.cc:341] T a9540fdebd564c91937a94648f5f07a5 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:37:58.129139 22676 leader_election.cc:341] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:58.125718 22990 tablet_bootstrap.cc:492] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc: No bootstrap required, opened a new log
I20260807 13:37:58.126008 22999 raft_consensus.cc:504] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.130453 22990 ts_tablet_manager.cc:1397] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc: Time spent bootstrapping tablet: real 0.149s user 0.009s sys 0.013s
I20260807 13:37:58.130857 22931 raft_consensus.cc:2379] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7816d0098bcf407f8a4db491fc5b1765 in current term 1: Already voted for candidate f1b6231195f34d7288d834af49866850 in this term.
I20260807 13:37:58.133783 22990 raft_consensus.cc:348] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.135370 22783 leader_election.cc:302] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7816d0098bcf407f8a4db491fc5b1765; no voters: 372a4f85197e454ca7320876e3b7c4fc, f1b6231195f34d7288d834af49866850
I20260807 13:37:58.138967 22993 tablet_bootstrap.cc:492] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765: No bootstrap required, opened a new log
I20260807 13:37:58.136914 22724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d1061583ccc4c4eb3f54133ec30ebbb" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
I20260807 13:37:58.139683 22993 ts_tablet_manager.cc:1397] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765: Time spent bootstrapping tablet: real 0.150s user 0.019s sys 0.008s
I20260807 13:37:58.139542 22931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9540fdebd564c91937a94648f5f07a5" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b6231195f34d7288d834af49866850" is_pre_election: true
I20260807 13:37:58.140282 23001 raft_consensus.cc:3037] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.142057 22931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a624e082005541a4b54ff5b7a4dd025e" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b6231195f34d7288d834af49866850" is_pre_election: true
I20260807 13:37:58.142688 22993 raft_consensus.cc:348] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.143462 22993 raft_consensus.cc:374] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:58.143790 22993 raft_consensus.cc:729] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7816d0098bcf407f8a4db491fc5b1765, State: Initialized, Role: FOLLOWER
W20260807 13:37:58.143996 22677 leader_election.cc:341] T a9540fdebd564c91937a94648f5f07a5 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1b6231195f34d7288d834af49866850 (127.21.69.3:41343): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:58.144600 22677 leader_election.cc:302] T a9540fdebd564c91937a94648f5f07a5 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc; no voters: 7816d0098bcf407f8a4db491fc5b1765, f1b6231195f34d7288d834af49866850
I20260807 13:37:58.145783 22995 raft_consensus.cc:2726] T a9540fdebd564c91937a94648f5f07a5 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 13:37:58.146605 22677 leader_election.cc:341] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1b6231195f34d7288d834af49866850 (127.21.69.3:41343): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:58.147269 22677 leader_election.cc:302] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc; no voters: 7816d0098bcf407f8a4db491fc5b1765, f1b6231195f34d7288d834af49866850
I20260807 13:37:58.148304 23001 raft_consensus.cc:2726] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:37:58.148322 22995 raft_consensus.cc:2726] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:37:58.149178 22990 raft_consensus.cc:374] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:58.138936 22987 ts_tablet_manager.cc:1428] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850: Time spent starting tablet: real 0.030s user 0.009s sys 0.002s
I20260807 13:37:58.144557 22993 consensus_queue.cc:260] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.149459 23019 raft_consensus.cc:686] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [term 1 LEADER]: Becoming Leader. State: Replica: f1b6231195f34d7288d834af49866850, State: Running, Role: LEADER
I20260807 13:37:58.151446 22993 ts_tablet_manager.cc:1428] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260807 13:37:58.150944 23019 consensus_queue.cc:237] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.149539 22990 raft_consensus.cc:729] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Initialized, Role: FOLLOWER
I20260807 13:37:58.152534 22993 tablet_bootstrap.cc:492] T 582d348a46de4d7c9ca05897b09e863f P 7816d0098bcf407f8a4db491fc5b1765: Bootstrap starting.
I20260807 13:37:58.153254 22987 tablet_bootstrap.cc:492] T 7c6d56e133e448138b6424f52ae64c02 P f1b6231195f34d7288d834af49866850: Bootstrap starting.
I20260807 13:37:58.154198 22828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d1061583ccc4c4eb3f54133ec30ebbb" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
I20260807 13:37:58.155248 22990 consensus_queue.cc:260] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.156440 22724 raft_consensus.cc:3037] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.159063 22993 tablet_bootstrap.cc:654] T 582d348a46de4d7c9ca05897b09e863f P 7816d0098bcf407f8a4db491fc5b1765: Neither blocks nor log segments found. Creating new log.
W20260807 13:37:58.159952 22965 tablet.cc:2369] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 13:37:58.160667 22990 ts_tablet_manager.cc:1428] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc: Time spent starting tablet: real 0.030s user 0.007s sys 0.000s
I20260807 13:37:58.161722 22990 tablet_bootstrap.cc:492] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc: Bootstrap starting.
I20260807 13:37:58.163497 22828 raft_consensus.cc:2454] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b6231195f34d7288d834af49866850 in term 1.
I20260807 13:37:58.167768 22724 raft_consensus.cc:2454] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b6231195f34d7288d834af49866850 in term 1.
I20260807 13:37:58.168009 22878 leader_election.cc:302] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7816d0098bcf407f8a4db491fc5b1765, f1b6231195f34d7288d834af49866850; no voters:
I20260807 13:37:58.169085 23025 raft_consensus.cc:2781] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:37:58.169651 23025 raft_consensus.cc:686] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [term 1 LEADER]: Becoming Leader. State: Replica: f1b6231195f34d7288d834af49866850, State: Running, Role: LEADER
I20260807 13:37:58.170516 23025 consensus_queue.cc:237] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.175205 23001 raft_consensus.cc:482] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:58.175815 23001 raft_consensus.cc:504] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.176075 22995 raft_consensus.cc:482] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:58.176838 22995 raft_consensus.cc:504] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.177977 23001 leader_election.cc:288] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:58.178901 22999 leader_election.cc:288] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 election: Requested vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001)
I20260807 13:37:58.179174 22725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "292b176c9c8c46d1b74684303c1c9d58" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372a4f85197e454ca7320876e3b7c4fc" is_pre_election: true
W20260807 13:37:58.181422 22780 leader_election.cc:341] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:58.181557 22931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb3496f0d6c4e8abf2c74435aab93b1" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b6231195f34d7288d834af49866850" is_pre_election: true
I20260807 13:37:58.183049 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "292b176c9c8c46d1b74684303c1c9d58" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b6231195f34d7288d834af49866850" is_pre_election: true
W20260807 13:37:58.183782 22677 leader_election.cc:341] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1b6231195f34d7288d834af49866850 (127.21.69.3:41343): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:58.184512 22995 leader_election.cc:288] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
W20260807 13:37:58.184559 22783 leader_election.cc:341] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1b6231195f34d7288d834af49866850 (127.21.69.3:41343): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:58.185189 22783 leader_election.cc:302] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7816d0098bcf407f8a4db491fc5b1765; no voters: 372a4f85197e454ca7320876e3b7c4fc, f1b6231195f34d7288d834af49866850
I20260807 13:37:58.186334 23001 raft_consensus.cc:2726] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:37:58.186970 22990 tablet_bootstrap.cc:654] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:58.191494 22828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb3496f0d6c4e8abf2c74435aab93b1" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7816d0098bcf407f8a4db491fc5b1765" is_pre_election: true
W20260807 13:37:58.193094 22676 leader_election.cc:341] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:58.193578 22676 leader_election.cc:302] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc; no voters: 7816d0098bcf407f8a4db491fc5b1765, f1b6231195f34d7288d834af49866850
I20260807 13:37:58.194878 22995 raft_consensus.cc:2726] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:37:58.197940 22987 tablet_bootstrap.cc:654] T 7c6d56e133e448138b6424f52ae64c02 P f1b6231195f34d7288d834af49866850: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:58.203701 22590 catalog_manager.cc:5495] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1b6231195f34d7288d834af49866850 (127.21.69.3). New cstate: current_term: 1 leader_uuid: "f1b6231195f34d7288d834af49866850" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: HEALTHY } } }
I20260807 13:37:58.205963 22993 tablet_bootstrap.cc:492] T 582d348a46de4d7c9ca05897b09e863f P 7816d0098bcf407f8a4db491fc5b1765: No bootstrap required, opened a new log
I20260807 13:37:58.208169 22993 ts_tablet_manager.cc:1397] T 582d348a46de4d7c9ca05897b09e863f P 7816d0098bcf407f8a4db491fc5b1765: Time spent bootstrapping tablet: real 0.056s user 0.022s sys 0.031s
I20260807 13:37:58.211110 22993 raft_consensus.cc:348] T 582d348a46de4d7c9ca05897b09e863f P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } }
I20260807 13:37:58.211838 22993 raft_consensus.cc:374] T 582d348a46de4d7c9ca05897b09e863f P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:58.212108 22993 raft_consensus.cc:729] T 582d348a46de4d7c9ca05897b09e863f P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7816d0098bcf407f8a4db491fc5b1765, State: Initialized, Role: FOLLOWER
I20260807 13:37:58.212831 22993 consensus_queue.cc:260] T 582d348a46de4d7c9ca05897b09e863f P 7816d0098bcf407f8a4db491fc5b1765 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } }
I20260807 13:37:58.214942 22993 ts_tablet_manager.cc:1428] T 582d348a46de4d7c9ca05897b09e863f P 7816d0098bcf407f8a4db491fc5b1765: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260807 13:37:58.206550 22990 tablet_bootstrap.cc:492] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc: No bootstrap required, opened a new log
I20260807 13:37:58.206856 22987 tablet_bootstrap.cc:492] T 7c6d56e133e448138b6424f52ae64c02 P f1b6231195f34d7288d834af49866850: No bootstrap required, opened a new log
I20260807 13:37:58.215989 22993 tablet_bootstrap.cc:492] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765: Bootstrap starting.
I20260807 13:37:58.216149 22987 ts_tablet_manager.cc:1397] T 7c6d56e133e448138b6424f52ae64c02 P f1b6231195f34d7288d834af49866850: Time spent bootstrapping tablet: real 0.063s user 0.010s sys 0.001s
I20260807 13:37:58.219380 22987 raft_consensus.cc:348] T 7c6d56e133e448138b6424f52ae64c02 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.220306 22987 raft_consensus.cc:374] T 7c6d56e133e448138b6424f52ae64c02 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:58.220633 22987 raft_consensus.cc:729] T 7c6d56e133e448138b6424f52ae64c02 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1b6231195f34d7288d834af49866850, State: Initialized, Role: FOLLOWER
I20260807 13:37:58.221347 22987 consensus_queue.cc:260] T 7c6d56e133e448138b6424f52ae64c02 P f1b6231195f34d7288d834af49866850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.223383 22987 ts_tablet_manager.cc:1428] T 7c6d56e133e448138b6424f52ae64c02 P f1b6231195f34d7288d834af49866850: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20260807 13:37:58.224105 22993 tablet_bootstrap.cc:654] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:58.224391 22987 tablet_bootstrap.cc:492] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850: Bootstrap starting.
I20260807 13:37:58.230182 22987 tablet_bootstrap.cc:654] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:58.230439 22993 tablet_bootstrap.cc:492] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765: No bootstrap required, opened a new log
I20260807 13:37:58.230978 22993 ts_tablet_manager.cc:1397] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.001s
I20260807 13:37:58.231967 22990 ts_tablet_manager.cc:1397] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc: Time spent bootstrapping tablet: real 0.070s user 0.012s sys 0.004s
I20260807 13:37:58.233918 22993 raft_consensus.cc:348] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.233969 22591 catalog_manager.cc:5495] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1b6231195f34d7288d834af49866850 (127.21.69.3). New cstate: current_term: 1 leader_uuid: "f1b6231195f34d7288d834af49866850" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: HEALTHY } } }
I20260807 13:37:58.234979 22993 raft_consensus.cc:374] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:58.235572 22990 raft_consensus.cc:348] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.238623 22990 raft_consensus.cc:374] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:58.238104 22993 raft_consensus.cc:729] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7816d0098bcf407f8a4db491fc5b1765, State: Initialized, Role: FOLLOWER
I20260807 13:37:58.239234 22990 raft_consensus.cc:729] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Initialized, Role: FOLLOWER
I20260807 13:37:58.239919 22993 consensus_queue.cc:260] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.240254 22990 consensus_queue.cc:260] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.246284 22990 ts_tablet_manager.cc:1428] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc: Time spent starting tablet: real 0.014s user 0.006s sys 0.001s
I20260807 13:37:58.248840 22993 ts_tablet_manager.cc:1428] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765: Time spent starting tablet: real 0.017s user 0.006s sys 0.001s
I20260807 13:37:58.252406 22993 tablet_bootstrap.cc:492] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765: Bootstrap starting.
I20260807 13:37:58.254622 23019 raft_consensus.cc:482] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:58.255309 23019 raft_consensus.cc:504] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } }
I20260807 13:37:58.258319 22990 tablet_bootstrap.cc:492] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc: Bootstrap starting.
I20260807 13:37:58.259171 22993 tablet_bootstrap.cc:654] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:58.260506 22724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "582d348a46de4d7c9ca05897b09e863f" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372a4f85197e454ca7320876e3b7c4fc" is_pre_election: true
I20260807 13:37:58.261037 23019 leader_election.cc:288] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001)
I20260807 13:37:58.261785 22828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "582d348a46de4d7c9ca05897b09e863f" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7816d0098bcf407f8a4db491fc5b1765" is_pre_election: true
I20260807 13:37:58.262429 22828 raft_consensus.cc:2454] T 582d348a46de4d7c9ca05897b09e863f P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1b6231195f34d7288d834af49866850 in term 0.
I20260807 13:37:58.263823 22878 leader_election.cc:302] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7816d0098bcf407f8a4db491fc5b1765, f1b6231195f34d7288d834af49866850; no voters:
W20260807 13:37:58.265331 22877 leader_election.cc:341] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:58.266366 23019 raft_consensus.cc:2781] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:37:58.266809 23019 raft_consensus.cc:482] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:37:58.267128 23019 raft_consensus.cc:3037] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.269013 22990 tablet_bootstrap.cc:654] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:58.269959 22987 tablet_bootstrap.cc:492] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850: No bootstrap required, opened a new log
I20260807 13:37:58.270510 22987 ts_tablet_manager.cc:1397] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850: Time spent bootstrapping tablet: real 0.046s user 0.022s sys 0.014s
I20260807 13:37:58.271557 22993 tablet_bootstrap.cc:492] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765: No bootstrap required, opened a new log
I20260807 13:37:58.272295 22993 ts_tablet_manager.cc:1397] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765: Time spent bootstrapping tablet: real 0.020s user 0.009s sys 0.009s
I20260807 13:37:58.273818 22987 raft_consensus.cc:348] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.274658 22987 raft_consensus.cc:374] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:58.274967 22987 raft_consensus.cc:729] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1b6231195f34d7288d834af49866850, State: Initialized, Role: FOLLOWER
I20260807 13:37:58.275852 22987 consensus_queue.cc:260] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.277966 23019 raft_consensus.cc:504] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } }
I20260807 13:37:58.278538 22993 raft_consensus.cc:348] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.279866 22993 raft_consensus.cc:374] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:58.280303 22993 raft_consensus.cc:729] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7816d0098bcf407f8a4db491fc5b1765, State: Initialized, Role: FOLLOWER
I20260807 13:37:58.280664 22987 ts_tablet_manager.cc:1428] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260807 13:37:58.281822 22987 tablet_bootstrap.cc:492] T a9540fdebd564c91937a94648f5f07a5 P f1b6231195f34d7288d834af49866850: Bootstrap starting.
I20260807 13:37:58.281698 22993 consensus_queue.cc:260] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.288645 22993 ts_tablet_manager.cc:1428] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765: Time spent starting tablet: real 0.016s user 0.006s sys 0.002s
I20260807 13:37:58.289080 22987 tablet_bootstrap.cc:654] T a9540fdebd564c91937a94648f5f07a5 P f1b6231195f34d7288d834af49866850: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:58.289862 22993 tablet_bootstrap.cc:492] T eeb3496f0d6c4e8abf2c74435aab93b1 P 7816d0098bcf407f8a4db491fc5b1765: Bootstrap starting.
I20260807 13:37:58.292464 22724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "582d348a46de4d7c9ca05897b09e863f" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
W20260807 13:37:58.294277 22877 leader_election.cc:341] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:58.298660 23025 raft_consensus.cc:482] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:58.299256 23025 raft_consensus.cc:504] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.300153 23019 leader_election.cc:288] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 election: Requested vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001)
I20260807 13:37:58.301508 23025 leader_election.cc:288] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001)
I20260807 13:37:58.302438 22993 tablet_bootstrap.cc:654] T eeb3496f0d6c4e8abf2c74435aab93b1 P 7816d0098bcf407f8a4db491fc5b1765: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:58.299422 22828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "582d348a46de4d7c9ca05897b09e863f" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
I20260807 13:37:58.303231 22828 raft_consensus.cc:3037] T 582d348a46de4d7c9ca05897b09e863f P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.303846 22987 tablet_bootstrap.cc:492] T a9540fdebd564c91937a94648f5f07a5 P f1b6231195f34d7288d834af49866850: No bootstrap required, opened a new log
I20260807 13:37:58.303840 22724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8078e36e4510492cb458f7f9ec29a87a" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372a4f85197e454ca7320876e3b7c4fc" is_pre_election: true
I20260807 13:37:58.304538 22987 ts_tablet_manager.cc:1397] T a9540fdebd564c91937a94648f5f07a5 P f1b6231195f34d7288d834af49866850: Time spent bootstrapping tablet: real 0.023s user 0.017s sys 0.003s
I20260807 13:37:58.305255 22827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8078e36e4510492cb458f7f9ec29a87a" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7816d0098bcf407f8a4db491fc5b1765" is_pre_election: true
W20260807 13:37:58.306816 22878 leader_election.cc:341] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:58.307442 22990 tablet_bootstrap.cc:492] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc: No bootstrap required, opened a new log
I20260807 13:37:58.308015 22990 ts_tablet_manager.cc:1397] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc: Time spent bootstrapping tablet: real 0.050s user 0.021s sys 0.009s
I20260807 13:37:58.307622 22987 raft_consensus.cc:348] T a9540fdebd564c91937a94648f5f07a5 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.308561 22987 raft_consensus.cc:374] T a9540fdebd564c91937a94648f5f07a5 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:58.308918 22987 raft_consensus.cc:729] T a9540fdebd564c91937a94648f5f07a5 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1b6231195f34d7288d834af49866850, State: Initialized, Role: FOLLOWER
I20260807 13:37:58.309762 22987 consensus_queue.cc:260] T a9540fdebd564c91937a94648f5f07a5 P f1b6231195f34d7288d834af49866850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.310937 22990 raft_consensus.cc:348] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.311733 22990 raft_consensus.cc:374] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:58.312036 22990 raft_consensus.cc:729] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Initialized, Role: FOLLOWER
I20260807 13:37:58.312547 22987 ts_tablet_manager.cc:1428] T a9540fdebd564c91937a94648f5f07a5 P f1b6231195f34d7288d834af49866850: Time spent starting tablet: real 0.008s user 0.007s sys 0.001s
I20260807 13:37:58.312876 22990 consensus_queue.cc:260] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.313599 22987 tablet_bootstrap.cc:492] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850: Bootstrap starting.
W20260807 13:37:58.312076 22877 leader_election.cc:341] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:58.314265 22877 leader_election.cc:302] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1b6231195f34d7288d834af49866850; no voters: 372a4f85197e454ca7320876e3b7c4fc, 7816d0098bcf407f8a4db491fc5b1765
I20260807 13:37:58.316366 22995 raft_consensus.cc:482] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:58.316977 22995 raft_consensus.cc:504] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.317945 22990 ts_tablet_manager.cc:1428] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260807 13:37:58.319079 22990 tablet_bootstrap.cc:492] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc: Bootstrap starting.
I20260807 13:37:58.320928 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c6d56e133e448138b6424f52ae64c02" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b6231195f34d7288d834af49866850" is_pre_election: true
I20260807 13:37:58.321705 22930 raft_consensus.cc:2454] T 7c6d56e133e448138b6424f52ae64c02 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 0.
I20260807 13:37:58.319409 22995 leader_election.cc:288] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:58.322813 22677 leader_election.cc:302] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc, f1b6231195f34d7288d834af49866850; no voters:
I20260807 13:37:58.323000 22827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c6d56e133e448138b6424f52ae64c02" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7816d0098bcf407f8a4db491fc5b1765" is_pre_election: true
I20260807 13:37:58.323958 22993 tablet_bootstrap.cc:492] T eeb3496f0d6c4e8abf2c74435aab93b1 P 7816d0098bcf407f8a4db491fc5b1765: No bootstrap required, opened a new log
I20260807 13:37:58.324025 22995 raft_consensus.cc:2781] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:37:58.324505 22995 raft_consensus.cc:482] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:37:58.324587 22676 leader_election.cc:341] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:58.324677 22993 ts_tablet_manager.cc:1397] T eeb3496f0d6c4e8abf2c74435aab93b1 P 7816d0098bcf407f8a4db491fc5b1765: Time spent bootstrapping tablet: real 0.035s user 0.009s sys 0.004s
I20260807 13:37:58.324889 22995 raft_consensus.cc:3037] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.325604 22990 tablet_bootstrap.cc:654] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:58.328158 22993 raft_consensus.cc:348] T eeb3496f0d6c4e8abf2c74435aab93b1 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.329107 22993 raft_consensus.cc:374] T eeb3496f0d6c4e8abf2c74435aab93b1 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:58.329471 22993 raft_consensus.cc:729] T eeb3496f0d6c4e8abf2c74435aab93b1 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7816d0098bcf407f8a4db491fc5b1765, State: Initialized, Role: FOLLOWER
I20260807 13:37:58.330394 22993 consensus_queue.cc:260] T eeb3496f0d6c4e8abf2c74435aab93b1 P 7816d0098bcf407f8a4db491fc5b1765 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.332902 22993 ts_tablet_manager.cc:1428] T eeb3496f0d6c4e8abf2c74435aab93b1 P 7816d0098bcf407f8a4db491fc5b1765: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260807 13:37:58.334156 22995 raft_consensus.cc:504] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.335763 22993 tablet_bootstrap.cc:492] T 7f2c02047eb84ad58db0a4e061758163 P 7816d0098bcf407f8a4db491fc5b1765: Bootstrap starting.
I20260807 13:37:58.336622 22987 tablet_bootstrap.cc:654] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:58.336815 23025 raft_consensus.cc:2726] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:37:58.341634 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c6d56e133e448138b6424f52ae64c02" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b6231195f34d7288d834af49866850"
I20260807 13:37:58.342363 22930 raft_consensus.cc:3037] T 7c6d56e133e448138b6424f52ae64c02 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.343317 22993 tablet_bootstrap.cc:654] T 7f2c02047eb84ad58db0a4e061758163 P 7816d0098bcf407f8a4db491fc5b1765: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:58.351814 22995 leader_election.cc:288] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 election: Requested vote from peers 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:58.352934 22930 raft_consensus.cc:2454] T 7c6d56e133e448138b6424f52ae64c02 P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 1.
I20260807 13:37:58.352607 22995 raft_consensus.cc:482] T 7f2c02047eb84ad58db0a4e061758163 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:58.358644 22677 leader_election.cc:302] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc, f1b6231195f34d7288d834af49866850; no voters:
I20260807 13:37:58.358542 22995 raft_consensus.cc:504] T 7f2c02047eb84ad58db0a4e061758163 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.369999 22827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c6d56e133e448138b6424f52ae64c02" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
W20260807 13:37:58.372061 22676 leader_election.cc:341] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:58.378527 22995 leader_election.cc:288] T 7f2c02047eb84ad58db0a4e061758163 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:58.379575 22995 raft_consensus.cc:2781] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:37:58.379774 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f2c02047eb84ad58db0a4e061758163" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b6231195f34d7288d834af49866850" is_pre_election: true
I20260807 13:37:58.380272 22995 raft_consensus.cc:686] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 1 LEADER]: Becoming Leader. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Running, Role: LEADER
W20260807 13:37:58.381911 22677 leader_election.cc:341] T 7f2c02047eb84ad58db0a4e061758163 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1b6231195f34d7288d834af49866850 (127.21.69.3:41343): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:58.381567 22995 consensus_queue.cc:237] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.378464 22827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f2c02047eb84ad58db0a4e061758163" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7816d0098bcf407f8a4db491fc5b1765" is_pre_election: true
I20260807 13:37:58.384064 22828 raft_consensus.cc:2454] T 582d348a46de4d7c9ca05897b09e863f P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b6231195f34d7288d834af49866850 in term 1.
W20260807 13:37:58.384225 22676 leader_election.cc:341] T 7f2c02047eb84ad58db0a4e061758163 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:58.384969 22676 leader_election.cc:302] T 7f2c02047eb84ad58db0a4e061758163 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc; no voters: 7816d0098bcf407f8a4db491fc5b1765, f1b6231195f34d7288d834af49866850
I20260807 13:37:58.385684 22878 leader_election.cc:302] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7816d0098bcf407f8a4db491fc5b1765, f1b6231195f34d7288d834af49866850; no voters: 372a4f85197e454ca7320876e3b7c4fc
I20260807 13:37:58.387063 23025 raft_consensus.cc:2781] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:37:58.392057 23025 raft_consensus.cc:686] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [term 1 LEADER]: Becoming Leader. State: Replica: f1b6231195f34d7288d834af49866850, State: Running, Role: LEADER
I20260807 13:37:58.393317 23025 consensus_queue.cc:237] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } }
I20260807 13:37:58.397682 22987 tablet_bootstrap.cc:492] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850: No bootstrap required, opened a new log
I20260807 13:37:58.398425 22987 ts_tablet_manager.cc:1397] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850: Time spent bootstrapping tablet: real 0.085s user 0.012s sys 0.006s
I20260807 13:37:58.405474 22987 raft_consensus.cc:348] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.408299 23045 raft_consensus.cc:2726] T 7f2c02047eb84ad58db0a4e061758163 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:37:58.407284 22987 raft_consensus.cc:374] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:58.411355 22987 raft_consensus.cc:729] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1b6231195f34d7288d834af49866850, State: Initialized, Role: FOLLOWER
I20260807 13:37:58.411792 22993 tablet_bootstrap.cc:492] T 7f2c02047eb84ad58db0a4e061758163 P 7816d0098bcf407f8a4db491fc5b1765: No bootstrap required, opened a new log
I20260807 13:37:58.412034 22990 tablet_bootstrap.cc:492] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc: No bootstrap required, opened a new log
I20260807 13:37:58.412339 22993 ts_tablet_manager.cc:1397] T 7f2c02047eb84ad58db0a4e061758163 P 7816d0098bcf407f8a4db491fc5b1765: Time spent bootstrapping tablet: real 0.077s user 0.037s sys 0.029s
I20260807 13:37:58.412559 22987 consensus_queue.cc:260] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.415552 22987 ts_tablet_manager.cc:1428] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850: Time spent starting tablet: real 0.017s user 0.003s sys 0.006s
I20260807 13:37:58.415336 22993 raft_consensus.cc:348] T 7f2c02047eb84ad58db0a4e061758163 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.416218 22993 raft_consensus.cc:374] T 7f2c02047eb84ad58db0a4e061758163 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:58.416528 22993 raft_consensus.cc:729] T 7f2c02047eb84ad58db0a4e061758163 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7816d0098bcf407f8a4db491fc5b1765, State: Initialized, Role: FOLLOWER
I20260807 13:37:58.420080 22993 consensus_queue.cc:260] T 7f2c02047eb84ad58db0a4e061758163 P 7816d0098bcf407f8a4db491fc5b1765 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.421654 22993 ts_tablet_manager.cc:1428] T 7f2c02047eb84ad58db0a4e061758163 P 7816d0098bcf407f8a4db491fc5b1765: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260807 13:37:58.422549 22993 tablet_bootstrap.cc:492] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765: Bootstrap starting.
I20260807 13:37:58.422475 22590 catalog_manager.cc:5495] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1b6231195f34d7288d834af49866850 (127.21.69.3). New cstate: current_term: 1 leader_uuid: "f1b6231195f34d7288d834af49866850" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:58.412602 22990 ts_tablet_manager.cc:1397] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc: Time spent bootstrapping tablet: real 0.094s user 0.044s sys 0.046s
I20260807 13:37:58.416548 22987 tablet_bootstrap.cc:492] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850: Bootstrap starting.
I20260807 13:37:58.427321 22990 raft_consensus.cc:348] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } }
I20260807 13:37:58.428356 22990 raft_consensus.cc:374] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:58.428699 22990 raft_consensus.cc:729] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Initialized, Role: FOLLOWER
I20260807 13:37:58.429610 22990 consensus_queue.cc:260] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } }
I20260807 13:37:58.431990 22990 ts_tablet_manager.cc:1428] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20260807 13:37:58.432945 22990 tablet_bootstrap.cc:492] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc: Bootstrap starting.
I20260807 13:37:58.433967 22993 tablet_bootstrap.cc:654] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:58.433717 22591 catalog_manager.cc:5495] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1). New cstate: current_term: 1 leader_uuid: "372a4f85197e454ca7320876e3b7c4fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:58.438138 22987 tablet_bootstrap.cc:654] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:58.438845 22990 tablet_bootstrap.cc:654] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:58.444331 22993 tablet_bootstrap.cc:492] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765: No bootstrap required, opened a new log
I20260807 13:37:58.444890 22993 ts_tablet_manager.cc:1397] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765: Time spent bootstrapping tablet: real 0.023s user 0.011s sys 0.000s
I20260807 13:37:58.447624 22993 raft_consensus.cc:348] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.448482 22987 tablet_bootstrap.cc:492] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850: No bootstrap required, opened a new log
I20260807 13:37:58.448519 22993 raft_consensus.cc:374] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:58.449160 22993 raft_consensus.cc:729] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7816d0098bcf407f8a4db491fc5b1765, State: Initialized, Role: FOLLOWER
I20260807 13:37:58.449276 22987 ts_tablet_manager.cc:1397] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850: Time spent bootstrapping tablet: real 0.033s user 0.011s sys 0.004s
I20260807 13:37:58.450011 22993 consensus_queue.cc:260] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.452298 22993 ts_tablet_manager.cc:1428] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 13:37:58.452328 22987 raft_consensus.cc:348] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.453186 22987 raft_consensus.cc:374] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:58.453531 22993 tablet_bootstrap.cc:492] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765: Bootstrap starting.
I20260807 13:37:58.453480 22987 raft_consensus.cc:729] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1b6231195f34d7288d834af49866850, State: Initialized, Role: FOLLOWER
I20260807 13:37:58.454487 22987 consensus_queue.cc:260] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.457710 22987 ts_tablet_manager.cc:1428] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260807 13:37:58.458976 23001 raft_consensus.cc:482] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:58.460234 22993 tablet_bootstrap.cc:654] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:58.459751 23001 raft_consensus.cc:504] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.463066 22995 raft_consensus.cc:482] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:58.463573 22995 raft_consensus.cc:504] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } }
I20260807 13:37:58.465813 22995 leader_election.cc:288] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1b6231195f34d7288d834af49866850 (127.21.69.3:41343), 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001)
I20260807 13:37:58.467450 22828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "582d348a46de4d7c9ca05897b09e863f" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7816d0098bcf407f8a4db491fc5b1765" is_pre_election: true
I20260807 13:37:58.467450 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "582d348a46de4d7c9ca05897b09e863f" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b6231195f34d7288d834af49866850" is_pre_election: true
I20260807 13:37:58.468379 22828 raft_consensus.cc:2379] T 582d348a46de4d7c9ca05897b09e863f P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 372a4f85197e454ca7320876e3b7c4fc in current term 1: Already voted for candidate f1b6231195f34d7288d834af49866850 in this term.
I20260807 13:37:58.469887 22677 leader_election.cc:302] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc; no voters: 7816d0098bcf407f8a4db491fc5b1765, f1b6231195f34d7288d834af49866850
I20260807 13:37:58.471016 22995 raft_consensus.cc:3037] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.472196 22724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a624e082005541a4b54ff5b7a4dd025e" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372a4f85197e454ca7320876e3b7c4fc" is_pre_election: true
I20260807 13:37:58.472914 22724 raft_consensus.cc:2454] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7816d0098bcf407f8a4db491fc5b1765 in term 0.
I20260807 13:37:58.474217 22780 leader_election.cc:302] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc, 7816d0098bcf407f8a4db491fc5b1765; no voters:
I20260807 13:37:58.475924 23001 leader_election.cc:288] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:58.476482 23001 raft_consensus.cc:2781] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:37:58.476840 23001 raft_consensus.cc:482] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:37:58.477170 23001 raft_consensus.cc:3037] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.479422 22990 tablet_bootstrap.cc:492] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc: No bootstrap required, opened a new log
I20260807 13:37:58.481406 22990 ts_tablet_manager.cc:1397] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc: Time spent bootstrapping tablet: real 0.049s user 0.005s sys 0.021s
I20260807 13:37:58.481196 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a624e082005541a4b54ff5b7a4dd025e" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b6231195f34d7288d834af49866850" is_pre_election: true
I20260807 13:37:58.482102 23025 raft_consensus.cc:482] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:58.482585 23025 raft_consensus.cc:504] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
W20260807 13:37:58.483381 22783 leader_election.cc:341] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1b6231195f34d7288d834af49866850 (127.21.69.3:41343): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:58.480618 22995 raft_consensus.cc:2726] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:37:58.484148 22990 raft_consensus.cc:348] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.485340 22990 raft_consensus.cc:374] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:58.485718 22990 raft_consensus.cc:729] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Initialized, Role: FOLLOWER
I20260807 13:37:58.485873 22724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb3496f0d6c4e8abf2c74435aab93b1" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372a4f85197e454ca7320876e3b7c4fc" is_pre_election: true
I20260807 13:37:58.486526 22724 raft_consensus.cc:2454] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1b6231195f34d7288d834af49866850 in term 0.
I20260807 13:37:58.486482 22990 consensus_queue.cc:260] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.487033 22828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb3496f0d6c4e8abf2c74435aab93b1" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7816d0098bcf407f8a4db491fc5b1765" is_pre_election: true
I20260807 13:37:58.487797 22877 leader_election.cc:302] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc, f1b6231195f34d7288d834af49866850; no voters:
I20260807 13:37:58.487933 22828 raft_consensus.cc:2454] T eeb3496f0d6c4e8abf2c74435aab93b1 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1b6231195f34d7288d834af49866850 in term 0.
I20260807 13:37:58.488723 23019 raft_consensus.cc:2781] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:37:58.489084 23019 raft_consensus.cc:482] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:37:58.489434 23019 raft_consensus.cc:3037] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.484882 23025 leader_election.cc:288] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001)
I20260807 13:37:58.491477 22990 ts_tablet_manager.cc:1428] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc: Time spent starting tablet: real 0.010s user 0.004s sys 0.002s
I20260807 13:37:58.492455 22990 tablet_bootstrap.cc:492] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc: Bootstrap starting.
I20260807 13:37:58.498092 22990 tablet_bootstrap.cc:654] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:58.508764 23019 raft_consensus.cc:504] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.458942 22987 tablet_bootstrap.cc:492] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850: Bootstrap starting.
I20260807 13:37:58.519295 22724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb3496f0d6c4e8abf2c74435aab93b1" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
I20260807 13:37:58.519857 22828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb3496f0d6c4e8abf2c74435aab93b1" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
I20260807 13:37:58.520305 22724 raft_consensus.cc:3037] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.520753 22828 raft_consensus.cc:3037] T eeb3496f0d6c4e8abf2c74435aab93b1 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.529353 23019 leader_election.cc:288] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 election: Requested vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001)
I20260807 13:37:58.533149 22828 raft_consensus.cc:2454] T eeb3496f0d6c4e8abf2c74435aab93b1 P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b6231195f34d7288d834af49866850 in term 1.
I20260807 13:37:58.533735 22724 raft_consensus.cc:2454] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b6231195f34d7288d834af49866850 in term 1.
I20260807 13:37:58.537647 22990 tablet_bootstrap.cc:492] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc: No bootstrap required, opened a new log
I20260807 13:37:58.538166 22990 ts_tablet_manager.cc:1397] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc: Time spent bootstrapping tablet: real 0.046s user 0.021s sys 0.015s
I20260807 13:37:58.537988 22877 leader_election.cc:302] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc, f1b6231195f34d7288d834af49866850; no voters:
I20260807 13:37:58.539033 22987 tablet_bootstrap.cc:654] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:58.539772 23019 raft_consensus.cc:2781] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:37:58.541046 22990 raft_consensus.cc:348] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.541846 22990 raft_consensus.cc:374] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:58.542172 22990 raft_consensus.cc:729] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Initialized, Role: FOLLOWER
I20260807 13:37:58.542744 23019 raft_consensus.cc:686] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [term 1 LEADER]: Becoming Leader. State: Replica: f1b6231195f34d7288d834af49866850, State: Running, Role: LEADER
I20260807 13:37:58.543233 22993 tablet_bootstrap.cc:492] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765: No bootstrap required, opened a new log
I20260807 13:37:58.543733 22993 ts_tablet_manager.cc:1397] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765: Time spent bootstrapping tablet: real 0.090s user 0.032s sys 0.056s
I20260807 13:37:58.542994 22990 consensus_queue.cc:260] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.543867 23019 consensus_queue.cc:237] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.545559 22990 ts_tablet_manager.cc:1428] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260807 13:37:58.535204 23001 raft_consensus.cc:504] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.546597 22993 raft_consensus.cc:348] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.547333 22993 raft_consensus.cc:374] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:58.547627 22993 raft_consensus.cc:729] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7816d0098bcf407f8a4db491fc5b1765, State: Initialized, Role: FOLLOWER
I20260807 13:37:58.548293 22993 consensus_queue.cc:260] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.550514 22993 ts_tablet_manager.cc:1428] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260807 13:37:58.552109 22724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a624e082005541a4b54ff5b7a4dd025e" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
I20260807 13:37:58.552740 22724 raft_consensus.cc:3037] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.556289 23001 leader_election.cc:288] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 1 election: Requested vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:58.557546 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a624e082005541a4b54ff5b7a4dd025e" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b6231195f34d7288d834af49866850"
W20260807 13:37:58.559633 22783 leader_election.cc:341] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1b6231195f34d7288d834af49866850 (127.21.69.3:41343): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:37:58.566470 22724 raft_consensus.cc:2454] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7816d0098bcf407f8a4db491fc5b1765 in term 1.
I20260807 13:37:58.572697 22780 leader_election.cc:302] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc, 7816d0098bcf407f8a4db491fc5b1765; no voters: f1b6231195f34d7288d834af49866850
I20260807 13:37:58.574234 23001 raft_consensus.cc:2781] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:37:58.574999 23001 raft_consensus.cc:686] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 1 LEADER]: Becoming Leader. State: Replica: 7816d0098bcf407f8a4db491fc5b1765, State: Running, Role: LEADER
I20260807 13:37:58.576305 23001 consensus_queue.cc:237] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.583487 22995 raft_consensus.cc:482] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:58.584141 22995 raft_consensus.cc:504] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.588745 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "792691555ea442f39ad0f98f9a406618" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b6231195f34d7288d834af49866850" is_pre_election: true
I20260807 13:37:58.590261 22828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "792691555ea442f39ad0f98f9a406618" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7816d0098bcf407f8a4db491fc5b1765" is_pre_election: true
I20260807 13:37:58.591485 22828 raft_consensus.cc:2379] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 372a4f85197e454ca7320876e3b7c4fc in current term 1: Already voted for candidate f1b6231195f34d7288d834af49866850 in this term.
I20260807 13:37:58.591871 22995 leader_election.cc:288] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:58.593250 22676 leader_election.cc:302] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc; no voters: 7816d0098bcf407f8a4db491fc5b1765, f1b6231195f34d7288d834af49866850
I20260807 13:37:58.594923 22995 raft_consensus.cc:3037] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.601128 23019 consensus_queue.cc:1035] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:37:58.606547 22587 catalog_manager.cc:5495] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2). New cstate: current_term: 1 leader_uuid: "7816d0098bcf407f8a4db491fc5b1765" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:58.611308 22995 raft_consensus.cc:2726] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:37:58.606889 22591 catalog_manager.cc:5495] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1b6231195f34d7288d834af49866850 (127.21.69.3). New cstate: current_term: 1 leader_uuid: "f1b6231195f34d7288d834af49866850" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: HEALTHY } } }
I20260807 13:37:58.613991 22987 tablet_bootstrap.cc:492] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850: No bootstrap required, opened a new log
I20260807 13:37:58.614522 22987 ts_tablet_manager.cc:1397] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850: Time spent bootstrapping tablet: real 0.156s user 0.033s sys 0.024s
I20260807 13:37:58.617439 22987 raft_consensus.cc:348] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.618252 22987 raft_consensus.cc:374] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:58.618552 22987 raft_consensus.cc:729] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1b6231195f34d7288d834af49866850, State: Initialized, Role: FOLLOWER
I20260807 13:37:58.620467 22987 consensus_queue.cc:260] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.622619 22987 ts_tablet_manager.cc:1428] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850: Time spent starting tablet: real 0.008s user 0.002s sys 0.004s
I20260807 13:37:58.623685 22987 tablet_bootstrap.cc:492] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850: Bootstrap starting.
I20260807 13:37:58.631152 22987 tablet_bootstrap.cc:654] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850: Neither blocks nor log segments found. Creating new log.
I20260807 13:37:58.639231 23001 raft_consensus.cc:482] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:58.640005 23001 raft_consensus.cc:504] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.643433 23001 leader_election.cc:288] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:58.644174 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9540fdebd564c91937a94648f5f07a5" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b6231195f34d7288d834af49866850" is_pre_election: true
I20260807 13:37:58.644972 22930 raft_consensus.cc:2454] T a9540fdebd564c91937a94648f5f07a5 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7816d0098bcf407f8a4db491fc5b1765 in term 0.
I20260807 13:37:58.645291 22724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9540fdebd564c91937a94648f5f07a5" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372a4f85197e454ca7320876e3b7c4fc" is_pre_election: true
I20260807 13:37:58.646035 22724 raft_consensus.cc:2454] T a9540fdebd564c91937a94648f5f07a5 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7816d0098bcf407f8a4db491fc5b1765 in term 0.
I20260807 13:37:58.646689 22783 leader_election.cc:302] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7816d0098bcf407f8a4db491fc5b1765, f1b6231195f34d7288d834af49866850; no voters:
I20260807 13:37:58.647753 23025 consensus_queue.cc:1035] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:37:58.648365 23001 raft_consensus.cc:2781] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:37:58.648885 23001 raft_consensus.cc:482] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:37:58.649336 23001 raft_consensus.cc:3037] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.659973 23001 raft_consensus.cc:504] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.663050 23001 leader_election.cc:288] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 1 election: Requested vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:58.663343 22725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9540fdebd564c91937a94648f5f07a5" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
I20260807 13:37:58.664037 22725 raft_consensus.cc:3037] T a9540fdebd564c91937a94648f5f07a5 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.664047 22987 tablet_bootstrap.cc:492] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850: No bootstrap required, opened a new log
I20260807 13:37:58.664985 22987 ts_tablet_manager.cc:1397] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850: Time spent bootstrapping tablet: real 0.041s user 0.012s sys 0.026s
I20260807 13:37:58.664951 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9540fdebd564c91937a94648f5f07a5" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b6231195f34d7288d834af49866850"
I20260807 13:37:58.666136 22930 raft_consensus.cc:3037] T a9540fdebd564c91937a94648f5f07a5 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.669320 22987 raft_consensus.cc:348] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.670523 22987 raft_consensus.cc:374] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:37:58.670964 22987 raft_consensus.cc:729] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1b6231195f34d7288d834af49866850, State: Initialized, Role: FOLLOWER
I20260807 13:37:58.671847 22725 raft_consensus.cc:2454] T a9540fdebd564c91937a94648f5f07a5 P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7816d0098bcf407f8a4db491fc5b1765 in term 1.
I20260807 13:37:58.673156 22780 leader_election.cc:302] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc, 7816d0098bcf407f8a4db491fc5b1765; no voters:
I20260807 13:37:58.672868 22987 consensus_queue.cc:260] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.674145 23001 raft_consensus.cc:2781] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:37:58.674863 23001 raft_consensus.cc:686] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765 [term 1 LEADER]: Becoming Leader. State: Replica: 7816d0098bcf407f8a4db491fc5b1765, State: Running, Role: LEADER
I20260807 13:37:58.676995 22987 ts_tablet_manager.cc:1428] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850: Time spent starting tablet: real 0.011s user 0.009s sys 0.000s
I20260807 13:37:58.676630 23001 consensus_queue.cc:237] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.677274 22930 raft_consensus.cc:2454] T a9540fdebd564c91937a94648f5f07a5 P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7816d0098bcf407f8a4db491fc5b1765 in term 1.
I20260807 13:37:58.682760 23019 consensus_queue.cc:1035] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:37:58.691895 22590 catalog_manager.cc:5495] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2). New cstate: current_term: 1 leader_uuid: "7816d0098bcf407f8a4db491fc5b1765" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:58.695832 22999 raft_consensus.cc:482] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:58.696377 22999 raft_consensus.cc:504] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.699033 22999 leader_election.cc:288] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001)
I20260807 13:37:58.699726 23001 raft_consensus.cc:482] T 7f2c02047eb84ad58db0a4e061758163 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:58.700220 23001 raft_consensus.cc:504] T 7f2c02047eb84ad58db0a4e061758163 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.702345 23001 leader_election.cc:288] T 7f2c02047eb84ad58db0a4e061758163 P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:58.703349 22725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f2c02047eb84ad58db0a4e061758163" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372a4f85197e454ca7320876e3b7c4fc" is_pre_election: true
I20260807 13:37:58.703869 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f2c02047eb84ad58db0a4e061758163" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b6231195f34d7288d834af49866850" is_pre_election: true
I20260807 13:37:58.704134 22725 raft_consensus.cc:2454] T 7f2c02047eb84ad58db0a4e061758163 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7816d0098bcf407f8a4db491fc5b1765 in term 0.
I20260807 13:37:58.704556 22930 raft_consensus.cc:2454] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7816d0098bcf407f8a4db491fc5b1765 in term 0.
I20260807 13:37:58.705614 22780 leader_election.cc:302] T 7f2c02047eb84ad58db0a4e061758163 P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc, 7816d0098bcf407f8a4db491fc5b1765; no voters:
I20260807 13:37:58.707209 22828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f2c02047eb84ad58db0a4e061758163" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7816d0098bcf407f8a4db491fc5b1765" is_pre_election: true
I20260807 13:37:58.707978 22828 raft_consensus.cc:2454] T 7f2c02047eb84ad58db0a4e061758163 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1b6231195f34d7288d834af49866850 in term 0.
I20260807 13:37:58.708027 22995 raft_consensus.cc:482] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:58.708247 22725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f2c02047eb84ad58db0a4e061758163" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372a4f85197e454ca7320876e3b7c4fc" is_pre_election: true
I20260807 13:37:58.708623 22995 raft_consensus.cc:504] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.709265 22725 raft_consensus.cc:2454] T 7f2c02047eb84ad58db0a4e061758163 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1b6231195f34d7288d834af49866850 in term 0.
I20260807 13:37:58.709524 23049 raft_consensus.cc:482] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:58.709872 22878 leader_election.cc:302] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7816d0098bcf407f8a4db491fc5b1765, f1b6231195f34d7288d834af49866850; no voters:
I20260807 13:37:58.710072 23049 raft_consensus.cc:504] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.711202 22999 raft_consensus.cc:2781] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:37:58.711596 22999 raft_consensus.cc:482] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:37:58.712020 22999 raft_consensus.cc:3037] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.712407 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8078e36e4510492cb458f7f9ec29a87a" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b6231195f34d7288d834af49866850" is_pre_election: true
I20260807 13:37:58.713148 22930 raft_consensus.cc:2454] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 0.
I20260807 13:37:58.713308 22995 leader_election.cc:288] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:58.713442 23049 leader_election.cc:288] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:58.714526 22677 leader_election.cc:302] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc, f1b6231195f34d7288d834af49866850; no voters:
I20260807 13:37:58.715018 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "292b176c9c8c46d1b74684303c1c9d58" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b6231195f34d7288d834af49866850" is_pre_election: true
I20260807 13:37:58.715719 22930 raft_consensus.cc:2454] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 0.
I20260807 13:37:58.716490 22827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "292b176c9c8c46d1b74684303c1c9d58" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7816d0098bcf407f8a4db491fc5b1765" is_pre_election: true
I20260807 13:37:58.716910 22677 leader_election.cc:302] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc, f1b6231195f34d7288d834af49866850; no voters:
I20260807 13:37:58.717163 22827 raft_consensus.cc:2454] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 0.
I20260807 13:37:58.717103 23001 raft_consensus.cc:2781] T 7f2c02047eb84ad58db0a4e061758163 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:37:58.717818 22995 raft_consensus.cc:2781] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:37:58.718261 22995 raft_consensus.cc:482] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:37:58.712466 22828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8078e36e4510492cb458f7f9ec29a87a" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7816d0098bcf407f8a4db491fc5b1765" is_pre_election: true
I20260807 13:37:58.718623 22995 raft_consensus.cc:3037] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.719115 22828 raft_consensus.cc:2454] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 0.
I20260807 13:37:58.709285 23025 consensus_queue.cc:1035] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260807 13:37:58.721752 22999 raft_consensus.cc:504] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.724172 22999 leader_election.cc:288] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 election: Requested vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001)
I20260807 13:37:58.722292 23049 raft_consensus.cc:2781] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:37:58.725973 23049 raft_consensus.cc:482] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:37:58.725980 22995 raft_consensus.cc:504] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.717859 23001 raft_consensus.cc:482] T 7f2c02047eb84ad58db0a4e061758163 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:37:58.726483 22725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f2c02047eb84ad58db0a4e061758163" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
I20260807 13:37:58.726418 22828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f2c02047eb84ad58db0a4e061758163" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
I20260807 13:37:58.726567 23049 raft_consensus.cc:3037] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.726962 23001 raft_consensus.cc:3037] T 7f2c02047eb84ad58db0a4e061758163 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.727243 22725 raft_consensus.cc:3037] T 7f2c02047eb84ad58db0a4e061758163 P 372a4f85197e454ca7320876e3b7c4fc [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:37:58.730664 22637 debug-util.cc:398] Leaking SignalData structure 0x7b080004e7e0 after lost signal to thread 21785
W20260807 13:37:58.731770 22637 debug-util.cc:398] Leaking SignalData structure 0x7b080004eec0 after lost signal to thread 22640
I20260807 13:37:58.731699 22995 leader_election.cc:288] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 election: Requested vote from peers 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:58.732844 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8078e36e4510492cb458f7f9ec29a87a" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b6231195f34d7288d834af49866850"
I20260807 13:37:58.733461 22930 raft_consensus.cc:3037] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.734855 22725 raft_consensus.cc:2454] T 7f2c02047eb84ad58db0a4e061758163 P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b6231195f34d7288d834af49866850 in term 1.
I20260807 13:37:58.735704 23001 raft_consensus.cc:504] T 7f2c02047eb84ad58db0a4e061758163 P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.735966 22877 leader_election.cc:302] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc, f1b6231195f34d7288d834af49866850; no voters:
I20260807 13:37:58.736882 22999 raft_consensus.cc:2781] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:37:58.737360 22999 raft_consensus.cc:686] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850 [term 1 LEADER]: Becoming Leader. State: Replica: f1b6231195f34d7288d834af49866850, State: Running, Role: LEADER
I20260807 13:37:58.737799 23001 leader_election.cc:288] T 7f2c02047eb84ad58db0a4e061758163 P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 1 election: Requested vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:58.738183 22999 consensus_queue.cc:237] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.740358 22931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f2c02047eb84ad58db0a4e061758163" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b6231195f34d7288d834af49866850"
I20260807 13:37:58.740497 22826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8078e36e4510492cb458f7f9ec29a87a" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
I20260807 13:37:58.741120 22826 raft_consensus.cc:3037] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.741631 22930 raft_consensus.cc:2454] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 1.
I20260807 13:37:58.742772 22677 leader_election.cc:302] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc, f1b6231195f34d7288d834af49866850; no voters:
I20260807 13:37:58.742717 23049 raft_consensus.cc:504] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.743486 22725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f2c02047eb84ad58db0a4e061758163" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
I20260807 13:37:58.743880 22995 raft_consensus.cc:2781] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:37:58.744287 22725 raft_consensus.cc:2379] T 7f2c02047eb84ad58db0a4e061758163 P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7816d0098bcf407f8a4db491fc5b1765 in current term 1: Already voted for candidate f1b6231195f34d7288d834af49866850 in this term.
I20260807 13:37:58.744611 22995 raft_consensus.cc:686] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [term 1 LEADER]: Becoming Leader. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Running, Role: LEADER
I20260807 13:37:58.745352 22780 leader_election.cc:302] T 7f2c02047eb84ad58db0a4e061758163 P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7816d0098bcf407f8a4db491fc5b1765; no voters: 372a4f85197e454ca7320876e3b7c4fc, f1b6231195f34d7288d834af49866850
I20260807 13:37:58.745530 22995 consensus_queue.cc:237] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.746013 22825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "292b176c9c8c46d1b74684303c1c9d58" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
I20260807 13:37:58.746567 23001 raft_consensus.cc:2726] T 7f2c02047eb84ad58db0a4e061758163 P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:37:58.746670 22825 raft_consensus.cc:3037] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.748214 22828 raft_consensus.cc:2379] T 7f2c02047eb84ad58db0a4e061758163 P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f1b6231195f34d7288d834af49866850 in current term 1: Already voted for candidate 7816d0098bcf407f8a4db491fc5b1765 in this term.
I20260807 13:37:58.762297 22590 catalog_manager.cc:5495] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1). New cstate: current_term: 1 leader_uuid: "372a4f85197e454ca7320876e3b7c4fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:58.766566 22826 raft_consensus.cc:2454] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 1.
I20260807 13:37:58.778478 22825 raft_consensus.cc:2454] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 1.
I20260807 13:37:58.779951 23049 leader_election.cc:288] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 election: Requested vote from peers 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:58.780004 22676 leader_election.cc:302] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc, 7816d0098bcf407f8a4db491fc5b1765; no voters:
I20260807 13:37:58.781213 23049 raft_consensus.cc:2781] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:37:58.781157 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "292b176c9c8c46d1b74684303c1c9d58" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b6231195f34d7288d834af49866850"
I20260807 13:37:58.782055 22930 raft_consensus.cc:3037] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.783995 23049 raft_consensus.cc:686] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [term 1 LEADER]: Becoming Leader. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Running, Role: LEADER
I20260807 13:37:58.784969 23049 consensus_queue.cc:237] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.787981 22591 catalog_manager.cc:5495] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1b6231195f34d7288d834af49866850 (127.21.69.3). New cstate: current_term: 1 leader_uuid: "f1b6231195f34d7288d834af49866850" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: HEALTHY } } }
I20260807 13:37:58.790262 22930 raft_consensus.cc:2454] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 1.
I20260807 13:37:58.801682 22591 catalog_manager.cc:5495] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1). New cstate: current_term: 1 leader_uuid: "372a4f85197e454ca7320876e3b7c4fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:58.826829 22999 consensus_queue.cc:1035] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:37:58.841414 23019 consensus_queue.cc:1035] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:37:58.857107 22930 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "582d348a46de4d7c9ca05897b09e863f"
dest_uuid: "f1b6231195f34d7288d834af49866850"
mode: GRACEFUL
new_leader_uuid: "372a4f85197e454ca7320876e3b7c4fc"
from {username='slave'} at 127.0.0.1:53236
I20260807 13:37:58.857942 22930 raft_consensus.cc:595] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [term 1 LEADER]: Received request to transfer leadership to TS 372a4f85197e454ca7320876e3b7c4fc
I20260807 13:37:58.859887 23019 raft_consensus.cc:979] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850: : Instructing follower 372a4f85197e454ca7320876e3b7c4fc to start an election
I20260807 13:37:58.860502 23024 raft_consensus.cc:1067] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [term 1 LEADER]: Signalling peer 372a4f85197e454ca7320876e3b7c4fc to start an election
I20260807 13:37:58.863734 22930 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4d1061583ccc4c4eb3f54133ec30ebbb"
dest_uuid: "f1b6231195f34d7288d834af49866850"
mode: GRACEFUL
new_leader_uuid: "372a4f85197e454ca7320876e3b7c4fc"
from {username='slave'} at 127.0.0.1:53236
I20260807 13:37:58.864370 22930 raft_consensus.cc:595] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [term 1 LEADER]: Received request to transfer leadership to TS 372a4f85197e454ca7320876e3b7c4fc
I20260807 13:37:58.874675 22724 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "582d348a46de4d7c9ca05897b09e863f"
dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
from {username='slave'} at 127.0.0.1:60814
I20260807 13:37:58.875351 22724 raft_consensus.cc:482] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:37:58.875779 22724 raft_consensus.cc:3037] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:58.884261 22724 raft_consensus.cc:504] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } }
I20260807 13:37:58.887025 22825 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a624e082005541a4b54ff5b7a4dd025e"
dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
mode: GRACEFUL
new_leader_uuid: "372a4f85197e454ca7320876e3b7c4fc"
from {username='slave'} at 127.0.0.1:58384
I20260807 13:37:58.887748 22825 raft_consensus.cc:595] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 1 LEADER]: Received request to transfer leadership to TS 372a4f85197e454ca7320876e3b7c4fc
I20260807 13:37:58.887877 22826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "582d348a46de4d7c9ca05897b09e863f" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
I20260807 13:37:58.888588 22826 raft_consensus.cc:3037] T 582d348a46de4d7c9ca05897b09e863f P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:58.888870 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "582d348a46de4d7c9ca05897b09e863f" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1b6231195f34d7288d834af49866850"
I20260807 13:37:58.889446 22930 raft_consensus.cc:3032] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:37:58.889740 22930 raft_consensus.cc:729] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1b6231195f34d7288d834af49866850, State: Running, Role: LEADER
I20260807 13:37:58.890564 22930 consensus_queue.cc:260] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } }
I20260807 13:37:58.891619 22930 raft_consensus.cc:3037] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:58.897113 22826 raft_consensus.cc:2454] T 582d348a46de4d7c9ca05897b09e863f P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 2.
I20260807 13:37:58.897886 22930 raft_consensus.cc:2454] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 2.
I20260807 13:37:58.898479 22676 leader_election.cc:302] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc, 7816d0098bcf407f8a4db491fc5b1765; no voters:
I20260807 13:37:58.899614 23049 raft_consensus.cc:2781] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:37:58.900135 23049 raft_consensus.cc:686] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [term 2 LEADER]: Becoming Leader. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Running, Role: LEADER
I20260807 13:37:58.900991 23049 consensus_queue.cc:237] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } }
I20260807 13:37:58.901404 22930 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "eeb3496f0d6c4e8abf2c74435aab93b1"
dest_uuid: "f1b6231195f34d7288d834af49866850"
mode: GRACEFUL
new_leader_uuid: "372a4f85197e454ca7320876e3b7c4fc"
from {username='slave'} at 127.0.0.1:53236
I20260807 13:37:58.901995 22930 raft_consensus.cc:595] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [term 1 LEADER]: Received request to transfer leadership to TS 372a4f85197e454ca7320876e3b7c4fc
I20260807 13:37:58.903913 22724 leader_election.cc:288] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 2 election: Requested vote from peers f1b6231195f34d7288d834af49866850 (127.21.69.3:41343), 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001)
I20260807 13:37:58.908250 22930 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "792691555ea442f39ad0f98f9a406618"
dest_uuid: "f1b6231195f34d7288d834af49866850"
mode: GRACEFUL
new_leader_uuid: "7816d0098bcf407f8a4db491fc5b1765"
from {username='slave'} at 127.0.0.1:53236
I20260807 13:37:58.909263 22930 raft_consensus.cc:595] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [term 1 LEADER]: Received request to transfer leadership to TS 7816d0098bcf407f8a4db491fc5b1765
I20260807 13:37:58.909960 22590 catalog_manager.cc:5495] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc reported cstate change: term changed from 1 to 2, leader changed from f1b6231195f34d7288d834af49866850 (127.21.69.3) to 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1). New cstate: current_term: 2 leader_uuid: "372a4f85197e454ca7320876e3b7c4fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:58.931813 23049 consensus_queue.cc:1035] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:37:58.936345 23001 raft_consensus.cc:482] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:37:58.936931 23001 raft_consensus.cc:504] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.939154 23001 leader_election.cc:288] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:58.939356 22724 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8078e36e4510492cb458f7f9ec29a87a"
dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
mode: GRACEFUL
new_leader_uuid: "7816d0098bcf407f8a4db491fc5b1765"
from {username='slave'} at 127.0.0.1:60830
I20260807 13:37:58.942049 22826 raft_consensus.cc:3037] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:58.943615 22724 raft_consensus.cc:595] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [term 1 LEADER]: Received request to transfer leadership to TS 7816d0098bcf407f8a4db491fc5b1765
I20260807 13:37:58.942309 22931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c6d56e133e448138b6424f52ae64c02" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1b6231195f34d7288d834af49866850" is_pre_election: true
I20260807 13:37:58.942967 22725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c6d56e133e448138b6424f52ae64c02" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372a4f85197e454ca7320876e3b7c4fc" is_pre_election: true
I20260807 13:37:58.954226 22780 leader_election.cc:302] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7816d0098bcf407f8a4db491fc5b1765; no voters: 372a4f85197e454ca7320876e3b7c4fc, f1b6231195f34d7288d834af49866850
I20260807 13:37:58.957969 22725 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7c6d56e133e448138b6424f52ae64c02"
dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
mode: GRACEFUL
new_leader_uuid: "7816d0098bcf407f8a4db491fc5b1765"
from {username='slave'} at 127.0.0.1:60830
I20260807 13:37:58.958592 22725 raft_consensus.cc:595] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 1 LEADER]: Received request to transfer leadership to TS 7816d0098bcf407f8a4db491fc5b1765
I20260807 13:37:58.967139 23001 raft_consensus.cc:2726] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:37:58.972544 23049 consensus_queue.cc:1035] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:37:58.981712 23045 raft_consensus.cc:979] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc: : Instructing follower 7816d0098bcf407f8a4db491fc5b1765 to start an election
I20260807 13:37:58.982254 23049 raft_consensus.cc:1067] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 1 LEADER]: Signalling peer 7816d0098bcf407f8a4db491fc5b1765 to start an election
I20260807 13:37:58.984462 22826 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7c6d56e133e448138b6424f52ae64c02"
dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
from {username='slave'} at 127.0.0.1:58356
I20260807 13:37:58.985004 22826 raft_consensus.cc:482] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:37:58.985332 22826 raft_consensus.cc:3037] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:58.993073 22826 raft_consensus.cc:504] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.996246 22725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c6d56e133e448138b6424f52ae64c02" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
I20260807 13:37:58.996938 22725 raft_consensus.cc:3032] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:37:58.997316 22725 raft_consensus.cc:729] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Running, Role: LEADER
I20260807 13:37:58.996953 22931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c6d56e133e448138b6424f52ae64c02" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1b6231195f34d7288d834af49866850"
I20260807 13:37:58.998047 22931 raft_consensus.cc:3037] T 7c6d56e133e448138b6424f52ae64c02 P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:58.998277 22725 consensus_queue.cc:260] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:58.999717 22725 raft_consensus.cc:3037] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:59.006544 22931 raft_consensus.cc:2454] T 7c6d56e133e448138b6424f52ae64c02 P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7816d0098bcf407f8a4db491fc5b1765 in term 2.
I20260807 13:37:59.006922 22725 raft_consensus.cc:2454] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7816d0098bcf407f8a4db491fc5b1765 in term 2.
I20260807 13:37:59.008096 22826 leader_election.cc:288] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 2 election: Requested vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:59.008036 22780 leader_election.cc:302] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc, 7816d0098bcf407f8a4db491fc5b1765; no voters:
I20260807 13:37:59.009009 23001 raft_consensus.cc:2781] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:37:59.009495 23001 raft_consensus.cc:686] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 2 LEADER]: Becoming Leader. State: Replica: 7816d0098bcf407f8a4db491fc5b1765, State: Running, Role: LEADER
I20260807 13:37:59.010378 23001 consensus_queue.cc:237] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:59.019122 22591 catalog_manager.cc:5495] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 reported cstate change: term changed from 1 to 2, leader changed from 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1) to 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2). New cstate: current_term: 2 leader_uuid: "7816d0098bcf407f8a4db491fc5b1765" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:59.047955 23019 consensus_queue.cc:1035] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:37:59.060273 23025 consensus_queue.cc:1035] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:37:59.070549 23024 raft_consensus.cc:979] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850: : Instructing follower 372a4f85197e454ca7320876e3b7c4fc to start an election
I20260807 13:37:59.071050 23024 raft_consensus.cc:1067] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [term 1 LEADER]: Signalling peer 372a4f85197e454ca7320876e3b7c4fc to start an election
I20260807 13:37:59.073143 22725 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "eeb3496f0d6c4e8abf2c74435aab93b1"
dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
from {username='slave'} at 127.0.0.1:60814
I20260807 13:37:59.073827 22725 raft_consensus.cc:482] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:37:59.074241 22725 raft_consensus.cc:3037] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:59.082633 22725 raft_consensus.cc:504] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:59.085132 22725 leader_election.cc:288] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 2 election: Requested vote from peers 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:59.086263 22931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb3496f0d6c4e8abf2c74435aab93b1" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1b6231195f34d7288d834af49866850"
I20260807 13:37:59.087131 22931 raft_consensus.cc:3032] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:37:59.086263 22826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb3496f0d6c4e8abf2c74435aab93b1" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
I20260807 13:37:59.087496 22931 raft_consensus.cc:729] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1b6231195f34d7288d834af49866850, State: Running, Role: LEADER
I20260807 13:37:59.087724 22826 raft_consensus.cc:3037] T eeb3496f0d6c4e8abf2c74435aab93b1 P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:59.088514 22931 consensus_queue.cc:260] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:59.090001 22931 raft_consensus.cc:3037] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:59.096103 22930 raft_consensus.cc:3037] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:37:59.098652 22931 raft_consensus.cc:2454] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 2.
I20260807 13:37:59.099471 22826 raft_consensus.cc:2454] T eeb3496f0d6c4e8abf2c74435aab93b1 P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 2.
I20260807 13:37:59.100111 22677 leader_election.cc:302] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc, f1b6231195f34d7288d834af49866850; no voters:
I20260807 13:37:59.101181 23049 raft_consensus.cc:2781] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:37:59.101779 23049 raft_consensus.cc:686] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [term 2 LEADER]: Becoming Leader. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Running, Role: LEADER
I20260807 13:37:59.102766 23049 consensus_queue.cc:237] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:59.106748 23001 consensus_queue.cc:1035] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:37:59.112056 22591 catalog_manager.cc:5495] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc reported cstate change: term changed from 1 to 2, leader changed from f1b6231195f34d7288d834af49866850 (127.21.69.3) to 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1). New cstate: current_term: 2 leader_uuid: "372a4f85197e454ca7320876e3b7c4fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:59.121831 23025 raft_consensus.cc:979] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850: : Instructing follower 7816d0098bcf407f8a4db491fc5b1765 to start an election
I20260807 13:37:59.122361 23025 raft_consensus.cc:1067] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [term 1 LEADER]: Signalling peer 7816d0098bcf407f8a4db491fc5b1765 to start an election
I20260807 13:37:59.127234 23056 consensus_queue.cc:1035] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [LEADER]: Connected to new peer: Peer: permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:37:59.127969 22826 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "792691555ea442f39ad0f98f9a406618"
dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
from {username='slave'} at 127.0.0.1:58372
I20260807 13:37:59.128818 22826 raft_consensus.cc:482] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:37:59.129341 22826 raft_consensus.cc:3037] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:59.133265 23025 consensus_queue.cc:1035] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:37:59.138521 23045 consensus_queue.cc:1035] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:37:59.145403 22826 raft_consensus.cc:504] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:59.149873 22726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "792691555ea442f39ad0f98f9a406618" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
I20260807 13:37:59.150589 22726 raft_consensus.cc:3037] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:59.156800 23045 consensus_queue.cc:1035] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:37:59.159550 23056 consensus_queue.cc:1035] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765 [LEADER]: Connected to new peer: Peer: permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:37:59.171502 22726 raft_consensus.cc:2454] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7816d0098bcf407f8a4db491fc5b1765 in term 2.
I20260807 13:37:59.172573 22722 raft_consensus.cc:1226] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Rejecting Update request from peer f1b6231195f34d7288d834af49866850 for earlier term 1. Current term is 2. Ops: []
I20260807 13:37:59.174860 23056 consensus_queue.cc:1035] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:37:59.176824 22780 leader_election.cc:302] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc, 7816d0098bcf407f8a4db491fc5b1765; no voters:
I20260807 13:37:59.177906 23001 raft_consensus.cc:2781] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:37:59.180172 23024 consensus_queue.cc:1046] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260807 13:37:59.183329 23024 raft_consensus.cc:3032] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:37:59.183813 23024 raft_consensus.cc:729] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1b6231195f34d7288d834af49866850, State: Running, Role: LEADER
I20260807 13:37:59.185065 23024 consensus_queue.cc:260] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:59.186916 23024 raft_consensus.cc:3037] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:59.192617 22931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "792691555ea442f39ad0f98f9a406618" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1b6231195f34d7288d834af49866850"
I20260807 13:37:59.200251 23104 raft_consensus.cc:979] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765: : Instructing follower 372a4f85197e454ca7320876e3b7c4fc to start an election
I20260807 13:37:59.201097 23104 raft_consensus.cc:1067] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 1 LEADER]: Signalling peer 372a4f85197e454ca7320876e3b7c4fc to start an election
I20260807 13:37:59.202310 23001 raft_consensus.cc:686] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [term 2 LEADER]: Becoming Leader. State: Replica: 7816d0098bcf407f8a4db491fc5b1765, State: Running, Role: LEADER
I20260807 13:37:59.203876 23001 consensus_queue.cc:237] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:59.197093 22826 leader_election.cc:288] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 2 election: Requested vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:59.207340 22723 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a624e082005541a4b54ff5b7a4dd025e"
dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
from {username='slave'} at 127.0.0.1:60804
I20260807 13:37:59.208031 22723 raft_consensus.cc:482] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:37:59.208400 22723 raft_consensus.cc:3037] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:59.226632 22723 raft_consensus.cc:504] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:59.230858 23025 consensus_queue.cc:1035] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:37:59.235489 22995 raft_consensus.cc:979] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc: : Instructing follower 7816d0098bcf407f8a4db491fc5b1765 to start an election
I20260807 13:37:59.236037 22995 raft_consensus.cc:1067] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [term 1 LEADER]: Signalling peer 7816d0098bcf407f8a4db491fc5b1765 to start an election
I20260807 13:37:59.233381 22999 raft_consensus.cc:979] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850: : Instructing follower 372a4f85197e454ca7320876e3b7c4fc to start an election
I20260807 13:37:59.237531 22999 raft_consensus.cc:1067] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [term 1 LEADER]: Signalling peer 372a4f85197e454ca7320876e3b7c4fc to start an election
I20260807 13:37:59.239073 22827 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8078e36e4510492cb458f7f9ec29a87a"
dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
from {username='slave'} at 127.0.0.1:58356
I20260807 13:37:59.239511 22724 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4d1061583ccc4c4eb3f54133ec30ebbb"
dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
from {username='slave'} at 127.0.0.1:60814
I20260807 13:37:59.240177 22724 raft_consensus.cc:482] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:37:59.240633 22724 raft_consensus.cc:3037] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:59.241346 22827 raft_consensus.cc:482] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:37:59.241839 22827 raft_consensus.cc:3037] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:59.249684 23049 consensus_queue.cc:1035] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:37:59.261129 22823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a624e082005541a4b54ff5b7a4dd025e" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
I20260807 13:37:59.261920 22823 raft_consensus.cc:3032] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:37:59.262274 22823 raft_consensus.cc:729] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7816d0098bcf407f8a4db491fc5b1765, State: Running, Role: LEADER
I20260807 13:37:59.263082 22723 leader_election.cc:288] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 2 election: Requested vote from peers 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:59.264552 22724 raft_consensus.cc:504] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:59.263146 22823 consensus_queue.cc:260] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:59.280961 22823 raft_consensus.cc:3037] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:59.288373 22724 leader_election.cc:288] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 2 election: Requested vote from peers 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:59.289278 22825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d1061583ccc4c4eb3f54133ec30ebbb" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
I20260807 13:37:59.289978 22825 raft_consensus.cc:3037] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:59.294862 22931 raft_consensus.cc:2454] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7816d0098bcf407f8a4db491fc5b1765 in term 2.
I20260807 13:37:59.297802 22825 raft_consensus.cc:2454] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 2.
I20260807 13:37:59.298849 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a624e082005541a4b54ff5b7a4dd025e" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1b6231195f34d7288d834af49866850"
I20260807 13:37:59.299487 22930 raft_consensus.cc:3037] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:59.299377 22676 leader_election.cc:302] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc, 7816d0098bcf407f8a4db491fc5b1765; no voters:
I20260807 13:37:59.303941 22995 consensus_queue.cc:1035] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:37:59.304949 23045 raft_consensus.cc:2781] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:37:59.311019 22827 raft_consensus.cc:504] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:59.315969 22929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d1061583ccc4c4eb3f54133ec30ebbb" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1b6231195f34d7288d834af49866850"
I20260807 13:37:59.316743 22929 raft_consensus.cc:3032] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:37:59.317090 22929 raft_consensus.cc:729] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1b6231195f34d7288d834af49866850, State: Running, Role: LEADER
I20260807 13:37:59.307178 22930 raft_consensus.cc:2454] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 2.
I20260807 13:37:59.322158 22827 leader_election.cc:288] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 2 election: Requested vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:37:59.322165 22927 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8078e36e4510492cb458f7f9ec29a87a" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1b6231195f34d7288d834af49866850"
I20260807 13:37:59.323019 22724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8078e36e4510492cb458f7f9ec29a87a" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
I20260807 13:37:59.323312 22927 raft_consensus.cc:3037] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:59.323698 22724 raft_consensus.cc:3032] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:37:59.321687 23045 raft_consensus.cc:686] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [term 2 LEADER]: Becoming Leader. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Running, Role: LEADER
I20260807 13:37:59.324047 22724 raft_consensus.cc:729] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Running, Role: LEADER
I20260807 13:37:59.327069 22677 leader_election.cc:302] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc, f1b6231195f34d7288d834af49866850; no voters:
I20260807 13:37:59.327724 22823 raft_consensus.cc:2454] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 2.
I20260807 13:37:59.327342 23045 consensus_queue.cc:237] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:59.329547 22995 raft_consensus.cc:2781] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:37:59.325551 22724 consensus_queue.cc:260] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:59.335956 22724 raft_consensus.cc:3037] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:59.334771 22995 raft_consensus.cc:686] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 2 LEADER]: Becoming Leader. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Running, Role: LEADER
I20260807 13:37:59.331614 22929 consensus_queue.cc:260] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:59.344547 22929 raft_consensus.cc:3037] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:37:59.348693 22724 raft_consensus.cc:2454] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7816d0098bcf407f8a4db491fc5b1765 in term 2.
I20260807 13:37:59.350126 22780 leader_election.cc:302] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc, 7816d0098bcf407f8a4db491fc5b1765; no voters:
I20260807 13:37:59.353255 23001 raft_consensus.cc:2781] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:37:59.353849 23001 raft_consensus.cc:686] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [term 2 LEADER]: Becoming Leader. State: Replica: 7816d0098bcf407f8a4db491fc5b1765, State: Running, Role: LEADER
I20260807 13:37:59.353466 22587 catalog_manager.cc:5495] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 reported cstate change: term changed from 1 to 2, leader changed from f1b6231195f34d7288d834af49866850 (127.21.69.3) to 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2). New cstate: current_term: 2 leader_uuid: "7816d0098bcf407f8a4db491fc5b1765" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: UNKNOWN } } }
I20260807 13:37:59.354789 23001 consensus_queue.cc:237] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:59.360962 22823 raft_consensus.cc:1261] T 582d348a46de4d7c9ca05897b09e863f P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Refusing update from remote peer 372a4f85197e454ca7320876e3b7c4fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:37:59.352342 22995 consensus_queue.cc:237] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:37:59.364001 23045 consensus_queue.cc:1035] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:37:59.370412 22929 raft_consensus.cc:2454] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 2.
I20260807 13:37:59.377561 22929 raft_consensus.cc:1261] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Refusing update from remote peer 372a4f85197e454ca7320876e3b7c4fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:37:59.379498 22995 consensus_queue.cc:1035] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:37:59.379863 22927 raft_consensus.cc:2454] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7816d0098bcf407f8a4db491fc5b1765 in term 2.
I20260807 13:38:00.259320 22929 raft_consensus.cc:1261] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Refusing update from remote peer 372a4f85197e454ca7320876e3b7c4fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:00.261034 23125 consensus_queue.cc:1035] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:00.262033 22929 raft_consensus.cc:1261] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Refusing update from remote peer 7816d0098bcf407f8a4db491fc5b1765: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:00.266259 22930 raft_consensus.cc:1261] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Refusing update from remote peer 7816d0098bcf407f8a4db491fc5b1765: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:00.269165 22724 raft_consensus.cc:1261] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Refusing update from remote peer 7816d0098bcf407f8a4db491fc5b1765: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:00.272616 22827 raft_consensus.cc:1261] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Refusing update from remote peer 372a4f85197e454ca7320876e3b7c4fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:00.274626 22827 raft_consensus.cc:1261] T eeb3496f0d6c4e8abf2c74435aab93b1 P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Refusing update from remote peer 372a4f85197e454ca7320876e3b7c4fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:00.277132 22827 raft_consensus.cc:1261] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Refusing update from remote peer 372a4f85197e454ca7320876e3b7c4fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:00.277527 22927 raft_consensus.cc:1261] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Refusing update from remote peer 372a4f85197e454ca7320876e3b7c4fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:00.279250 23121 consensus_queue.cc:1035] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:00.280324 23123 consensus_queue.cc:1035] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:38:00.289981 22723 raft_consensus.cc:1261] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Refusing update from remote peer 7816d0098bcf407f8a4db491fc5b1765: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:00.299070 23124 consensus_queue.cc:1035] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [LEADER]: Connected to new peer: Peer: permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:38:00.307272 23120 consensus_queue.cc:1035] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:00.343235 22928 raft_consensus.cc:1261] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Refusing update from remote peer 372a4f85197e454ca7320876e3b7c4fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:00.345309 23127 consensus_queue.cc:1035] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:00.347976 23127 consensus_queue.cc:1035] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:38:00.309376 23128 consensus_queue.cc:1035] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [LEADER]: Connected to new peer: Peer: permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
W20260807 13:38:00.360303 23136 log.cc:924] Time spent T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
I20260807 13:38:00.361475 22931 raft_consensus.cc:1261] T 7c6d56e133e448138b6424f52ae64c02 P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Refusing update from remote peer 7816d0098bcf407f8a4db491fc5b1765: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:00.362649 23131 consensus_queue.cc:1035] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:00.364176 23131 consensus_queue.cc:1035] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260807 13:38:00.368408 22780 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:33643, user_credentials={real_user=slave}} blocked reactor thread for 76928.9us
I20260807 13:38:00.388846 22587 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41570 (request call id 35) took 1072 ms. Trace:
I20260807 13:38:00.395553 22591 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41578 (request call id 27) took 1009 ms. Trace:
I20260807 13:38:00.399927 22591 rpcz_store.cc:276] 0807 13:37:59.386269 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:37:59.386455 (+ 186us) service_pool.cc:227] Handling call
0807 13:38:00.395477 (+1009022us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":115590,"reported_tablets":5}
I20260807 13:38:00.389376 22587 rpcz_store.cc:276] 0807 13:37:59.316671 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:37:59.318892 (+ 2221us) service_pool.cc:227] Handling call
0807 13:38:00.388763 (+1069871us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:37:59.360031 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:37:59.360979 (+ 948us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:37:59.361012 (+ 33us) write_op.cc:435] Acquired schema lock
0807 13:37:59.361030 (+ 18us) tablet.cc:660] Decoding operations
0807 13:37:59.361389 (+ 359us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:37:59.361444 (+ 55us) write_op.cc:641] Partition lock acquired for write op
0807 13:37:59.361470 (+ 26us) tablet.cc:683] Acquiring locks for 1 operations
0807 13:37:59.361688 (+ 218us) tablet.cc:699] Row locks acquired
0807 13:37:59.361700 (+ 12us) write_op.cc:260] PREPARE: finished
0807 13:37:59.361844 (+ 144us) write_op.cc:270] Start()
0807 13:37:59.361955 (+ 111us) write_op.cc:276] Timestamp: P: 1786109879361801 usec, L: 0
0807 13:37:59.361975 (+ 20us) op_driver.cc:331] REPLICATION: starting
0807 13:37:59.362658 (+ 683us) log.cc:842] Serialized 534 byte log entry
0807 13:37:59.365138 (+ 2480us) op_driver.cc:444] REPLICATION: finished
0807 13:37:59.365528 (+ 390us) write_op.cc:301] APPLY: starting
0807 13:37:59.365604 (+ 76us) tablet.cc:1365] starting BulkCheckPresence
0807 13:37:59.365704 (+ 100us) tablet.cc:1368] finished BulkCheckPresence
0807 13:37:59.365826 (+ 122us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:37:59.366000 (+ 174us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:37:59.366180 (+ 180us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 13:37:59.366235 (+ 55us) write_op.cc:312] APPLY: finished
0807 13:37:59.366477 (+ 242us) log.cc:842] Serialized 22 byte log entry
0807 13:37:59.366644 (+ 167us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:37:59.366734 (+ 90us) write_op.cc:454] Released schema lock
0807 13:37:59.366773 (+ 39us) write_op.cc:341] FINISH: Updating metrics
0807 13:37:59.367003 (+ 230us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:37:59.367033 (+ 30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":87943,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":206,"apply.run_cpu_time_us":1710,"apply.run_wall_time_us":1708,"num_ops":1,"prepare.queue_time_us":187,"prepare.run_cpu_time_us":2688,"prepare.run_wall_time_us":2906,"replication_time_us":3060}]]}
I20260807 13:38:00.398272 22590 catalog_manager.cc:5495] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc reported cstate change: term changed from 1 to 2, leader changed from f1b6231195f34d7288d834af49866850 (127.21.69.3) to 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1). New cstate: current_term: 2 leader_uuid: "372a4f85197e454ca7320876e3b7c4fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:00.409499 22723 raft_consensus.cc:1261] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Refusing update from remote peer 7816d0098bcf407f8a4db491fc5b1765: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:00.406812 22590 catalog_manager.cc:5495] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc reported cstate change: term changed from 1 to 2, leader changed from 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2) to 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1). New cstate: current_term: 2 leader_uuid: "372a4f85197e454ca7320876e3b7c4fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: UNKNOWN } } }
W20260807 13:38:00.424839 22783 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:41343, user_credentials={real_user=slave}} blocked reactor thread for 48635.1us
I20260807 13:38:00.426154 23124 consensus_queue.cc:1035] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260807 13:38:00.429646 23128 consensus_queue.cc:1035] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [LEADER]: Connected to new peer: Peer: permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260807 13:38:00.526100 22590 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41554 (request call id 31) took 1156 ms. Trace:
I20260807 13:38:00.527163 22587 catalog_manager.cc:5495] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850 reported cstate change: term changed from 1 to 2, leader changed from 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1) to 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2). New cstate: current_term: 2 leader_uuid: "7816d0098bcf407f8a4db491fc5b1765" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } } }
I20260807 13:38:00.526587 22590 rpcz_store.cc:276] 0807 13:37:59.369696 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:37:59.369884 (+ 188us) service_pool.cc:227] Handling call
0807 13:38:00.526020 (+1156136us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:38:00.450606 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:38:00.451394 (+ 788us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:38:00.451424 (+ 30us) write_op.cc:435] Acquired schema lock
0807 13:38:00.451439 (+ 15us) tablet.cc:660] Decoding operations
0807 13:38:00.451904 (+ 465us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:38:00.451978 (+ 74us) write_op.cc:641] Partition lock acquired for write op
0807 13:38:00.452009 (+ 31us) tablet.cc:683] Acquiring locks for 2 operations
0807 13:38:00.452342 (+ 333us) tablet.cc:699] Row locks acquired
0807 13:38:00.452366 (+ 24us) write_op.cc:260] PREPARE: finished
0807 13:38:00.452516 (+ 150us) write_op.cc:270] Start()
0807 13:38:00.452613 (+ 97us) write_op.cc:276] Timestamp: P: 1786109880452468 usec, L: 0
0807 13:38:00.452635 (+ 22us) op_driver.cc:331] REPLICATION: starting
0807 13:38:00.453328 (+ 693us) log.cc:842] Serialized 916 byte log entry
0807 13:38:00.520187 (+ 66859us) op_driver.cc:444] REPLICATION: finished
0807 13:38:00.521764 (+ 1577us) write_op.cc:301] APPLY: starting
0807 13:38:00.521847 (+ 83us) tablet.cc:1365] starting BulkCheckPresence
0807 13:38:00.521982 (+ 135us) tablet.cc:1368] finished BulkCheckPresence
0807 13:38:00.522121 (+ 139us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:38:00.522394 (+ 273us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:38:00.522519 (+ 125us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0807 13:38:00.522557 (+ 38us) write_op.cc:312] APPLY: finished
0807 13:38:00.522724 (+ 167us) log.cc:842] Serialized 28 byte log entry
0807 13:38:00.522916 (+ 192us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:38:00.522994 (+ 78us) write_op.cc:454] Released schema lock
0807 13:38:00.523028 (+ 34us) write_op.cc:341] FINISH: Updating metrics
0807 13:38:00.523241 (+ 213us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:38:00.523266 (+ 25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1005184,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":1327,"apply.run_cpu_time_us":1758,"apply.run_wall_time_us":1758,"num_ops":2,"prepare.queue_time_us":26138,"prepare.run_cpu_time_us":4162,"prepare.run_wall_time_us":70899,"raft.queue_time_us":1327,"raft.run_cpu_time_us":1551,"raft.run_wall_time_us":3899,"replication_time_us":67447,"spinlock_wait_cycles":50560,"thread_start_us":85445,"threads_started":4,"wal-append.queue_time_us":63575}]]}
W20260807 13:38:01.343034 22960 debug-util.cc:398] Leaking SignalData structure 0x7b08000ab720 after lost signal to thread 21785
W20260807 13:38:01.343986 22960 debug-util.cc:398] Leaking SignalData structure 0x7b08000abe00 after lost signal to thread 22640
W20260807 13:38:01.345005 22960 debug-util.cc:398] Leaking SignalData structure 0x7b08000e1ba0 after lost signal to thread 22758
W20260807 13:38:01.345813 22960 debug-util.cc:398] Leaking SignalData structure 0x7b08000c2b20 after lost signal to thread 22860
W20260807 13:38:01.346779 22960 debug-util.cc:398] Leaking SignalData structure 0x7b080008d0e0 after lost signal to thread 22963
I20260807 13:38:02.019604 21780 auto_leader_rebalancer-test.cc:339] The leader distribution is
I20260807 13:38:02.020649 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:38:02.074539 22725 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "292b176c9c8c46d1b74684303c1c9d58"
dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
mode: GRACEFUL
new_leader_uuid: "f1b6231195f34d7288d834af49866850"
from {username='slave'} at 127.0.0.1:60842
I20260807 13:38:02.075359 22725 raft_consensus.cc:595] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [term 1 LEADER]: Received request to transfer leadership to TS f1b6231195f34d7288d834af49866850
I20260807 13:38:02.078584 22725 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a624e082005541a4b54ff5b7a4dd025e"
dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
mode: GRACEFUL
new_leader_uuid: "f1b6231195f34d7288d834af49866850"
from {username='slave'} at 127.0.0.1:60842
I20260807 13:38:02.079303 22725 raft_consensus.cc:595] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 2 LEADER]: Received request to transfer leadership to TS f1b6231195f34d7288d834af49866850
I20260807 13:38:02.080693 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260807 13:38:02.081384 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:38:02.094792 23123 raft_consensus.cc:979] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc: : Instructing follower f1b6231195f34d7288d834af49866850 to start an election
I20260807 13:38:02.095420 23173 raft_consensus.cc:1067] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [term 1 LEADER]: Signalling peer f1b6231195f34d7288d834af49866850 to start an election
I20260807 13:38:02.097510 22929 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "292b176c9c8c46d1b74684303c1c9d58"
dest_uuid: "f1b6231195f34d7288d834af49866850"
from {username='slave'} at 127.0.0.1:53212
I20260807 13:38:02.098235 22929 raft_consensus.cc:482] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:38:02.098649 22929 raft_consensus.cc:3037] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:02.107905 22929 raft_consensus.cc:504] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:02.112273 22823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "292b176c9c8c46d1b74684303c1c9d58" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
I20260807 13:38:02.113055 22823 raft_consensus.cc:3037] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:02.110788 22929 leader_election.cc:288] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 2 election: Requested vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001)
I20260807 13:38:02.118202 22725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "292b176c9c8c46d1b74684303c1c9d58" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
I20260807 13:38:02.119006 22725 raft_consensus.cc:3032] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:02.119402 22725 raft_consensus.cc:729] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Running, Role: LEADER
I20260807 13:38:02.120443 22725 consensus_queue.cc:260] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:02.121970 22725 raft_consensus.cc:3037] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:02.132190 22823 raft_consensus.cc:2454] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b6231195f34d7288d834af49866850 in term 2.
I20260807 13:38:02.132833 22725 raft_consensus.cc:2454] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b6231195f34d7288d834af49866850 in term 2.
I20260807 13:38:02.133940 22878 leader_election.cc:302] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7816d0098bcf407f8a4db491fc5b1765, f1b6231195f34d7288d834af49866850; no voters:
I20260807 13:38:02.135118 23175 raft_consensus.cc:2781] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:38:02.136686 23175 raft_consensus.cc:686] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [term 2 LEADER]: Becoming Leader. State: Replica: f1b6231195f34d7288d834af49866850, State: Running, Role: LEADER
I20260807 13:38:02.137692 23175 consensus_queue.cc:237] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:02.149585 22590 catalog_manager.cc:5495] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 reported cstate change: term changed from 1 to 2, leader changed from 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1) to f1b6231195f34d7288d834af49866850 (127.21.69.3). New cstate: current_term: 2 leader_uuid: "f1b6231195f34d7288d834af49866850" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: HEALTHY } } }
I20260807 13:38:02.373272 23173 raft_consensus.cc:979] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc: : Instructing follower f1b6231195f34d7288d834af49866850 to start an election
I20260807 13:38:02.373893 23123 raft_consensus.cc:1067] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 2 LEADER]: Signalling peer f1b6231195f34d7288d834af49866850 to start an election
I20260807 13:38:02.376080 22929 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a624e082005541a4b54ff5b7a4dd025e"
dest_uuid: "f1b6231195f34d7288d834af49866850"
from {username='slave'} at 127.0.0.1:53212
I20260807 13:38:02.376791 22929 raft_consensus.cc:482] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:38:02.377245 22929 raft_consensus.cc:3037] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:02.386493 22929 raft_consensus.cc:504] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:02.390443 22929 leader_election.cc:288] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 3 election: Requested vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001)
I20260807 13:38:02.392227 22823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a624e082005541a4b54ff5b7a4dd025e" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
I20260807 13:38:02.393019 22823 raft_consensus.cc:3037] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:02.394819 22725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a624e082005541a4b54ff5b7a4dd025e" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
I20260807 13:38:02.395561 22725 raft_consensus.cc:3032] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:38:02.395970 22725 raft_consensus.cc:729] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Running, Role: LEADER
I20260807 13:38:02.396863 22725 consensus_queue.cc:260] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:02.398363 22725 raft_consensus.cc:3037] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:02.402447 22823 raft_consensus.cc:2454] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b6231195f34d7288d834af49866850 in term 3.
I20260807 13:38:02.404029 22878 leader_election.cc:302] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7816d0098bcf407f8a4db491fc5b1765, f1b6231195f34d7288d834af49866850; no voters:
I20260807 13:38:02.405236 23175 raft_consensus.cc:2781] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:02.405831 23175 raft_consensus.cc:686] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 3 LEADER]: Becoming Leader. State: Replica: f1b6231195f34d7288d834af49866850, State: Running, Role: LEADER
I20260807 13:38:02.406873 23175 consensus_queue.cc:237] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:02.409340 22725 raft_consensus.cc:2454] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b6231195f34d7288d834af49866850 in term 3.
I20260807 13:38:02.428735 22590 catalog_manager.cc:5495] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 reported cstate change: term changed from 2 to 3, leader changed from 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1) to f1b6231195f34d7288d834af49866850 (127.21.69.3). New cstate: current_term: 3 leader_uuid: "f1b6231195f34d7288d834af49866850" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: HEALTHY } } }
I20260807 13:38:02.663396 22725 raft_consensus.cc:1261] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Refusing update from remote peer f1b6231195f34d7288d834af49866850: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:02.665948 23175 consensus_queue.cc:1035] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:02.703706 22823 raft_consensus.cc:1261] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Refusing update from remote peer f1b6231195f34d7288d834af49866850: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:02.705693 23182 consensus_queue.cc:1035] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:02.807333 22725 raft_consensus.cc:1261] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 3 FOLLOWER]: Refusing update from remote peer f1b6231195f34d7288d834af49866850: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:38:02.809157 23182 consensus_queue.cc:1035] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:38:02.824781 22823 raft_consensus.cc:1261] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Refusing update from remote peer f1b6231195f34d7288d834af49866850: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:38:02.827262 23182 consensus_queue.cc:1035] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:38:03.082463 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:38:03.092094 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:38:03.092739 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:38:04.093876 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:38:04.104015 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:38:04.104700 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:38:05.106510 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:38:05.120545 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:38:05.121345 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:38:06.122328 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:38:06.128167 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:38:06.128676 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:38:07.129549 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:38:07.135360 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:38:07.135881 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:38:08.136937 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:38:08.143293 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:38:08.143874 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:38:09.144829 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:38:09.150588 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:38:09.151099 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:38:10.152113 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:38:10.158223 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:38:10.158730 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:38:11.159917 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:38:11.165607 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:38:11.166157 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:38:12.200702 21780 auto_leader_rebalancer-test.cc:358] The leader distribution is
I20260807 13:38:12.211133 22928 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "292b176c9c8c46d1b74684303c1c9d58"
dest_uuid: "f1b6231195f34d7288d834af49866850"
mode: GRACEFUL
new_leader_uuid: "372a4f85197e454ca7320876e3b7c4fc"
from {username='slave'} at 127.0.0.1:53236
I20260807 13:38:12.211973 22928 raft_consensus.cc:595] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [term 2 LEADER]: Received request to transfer leadership to TS 372a4f85197e454ca7320876e3b7c4fc
I20260807 13:38:12.217455 22928 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a624e082005541a4b54ff5b7a4dd025e"
dest_uuid: "f1b6231195f34d7288d834af49866850"
mode: GRACEFUL
new_leader_uuid: "372a4f85197e454ca7320876e3b7c4fc"
from {username='slave'} at 127.0.0.1:53236
I20260807 13:38:12.218132 22928 raft_consensus.cc:595] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 3 LEADER]: Received request to transfer leadership to TS 372a4f85197e454ca7320876e3b7c4fc
I20260807 13:38:12.222353 23215 raft_consensus.cc:979] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850: : Instructing follower 372a4f85197e454ca7320876e3b7c4fc to start an election
I20260807 13:38:12.223016 23215 raft_consensus.cc:1067] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 3 LEADER]: Signalling peer 372a4f85197e454ca7320876e3b7c4fc to start an election
I20260807 13:38:12.224756 22725 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a624e082005541a4b54ff5b7a4dd025e"
dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
from {username='slave'} at 127.0.0.1:60814
I20260807 13:38:12.225309 22725 raft_consensus.cc:482] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:38:12.225693 22725 raft_consensus.cc:3037] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:12.228976 22828 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "792691555ea442f39ad0f98f9a406618"
dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
mode: GRACEFUL
new_leader_uuid: "372a4f85197e454ca7320876e3b7c4fc"
from {username='slave'} at 127.0.0.1:58384
I20260807 13:38:12.229626 22828 raft_consensus.cc:595] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [term 2 LEADER]: Received request to transfer leadership to TS 372a4f85197e454ca7320876e3b7c4fc
I20260807 13:38:12.234575 22725 raft_consensus.cc:504] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:12.236253 22823 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8078e36e4510492cb458f7f9ec29a87a"
dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
mode: GRACEFUL
new_leader_uuid: "372a4f85197e454ca7320876e3b7c4fc"
from {username='slave'} at 127.0.0.1:58384
I20260807 13:38:12.236891 22823 raft_consensus.cc:595] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [term 2 LEADER]: Received request to transfer leadership to TS 372a4f85197e454ca7320876e3b7c4fc
I20260807 13:38:12.236986 22725 leader_election.cc:288] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 4 election: Requested vote from peers 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:38:12.238138 22928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a624e082005541a4b54ff5b7a4dd025e" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f1b6231195f34d7288d834af49866850"
I20260807 13:38:12.238143 22828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a624e082005541a4b54ff5b7a4dd025e" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
I20260807 13:38:12.239105 22928 raft_consensus.cc:3032] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:38:12.239226 22828 raft_consensus.cc:3037] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:12.239463 22928 raft_consensus.cc:729] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f1b6231195f34d7288d834af49866850, State: Running, Role: LEADER
I20260807 13:38:12.240579 22928 consensus_queue.cc:260] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:12.241899 22928 raft_consensus.cc:3037] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:12.247370 22828 raft_consensus.cc:2454] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 4.
I20260807 13:38:12.248829 22676 leader_election.cc:302] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc, 7816d0098bcf407f8a4db491fc5b1765; no voters:
I20260807 13:38:12.249178 22928 raft_consensus.cc:2454] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 4.
I20260807 13:38:12.249910 23213 raft_consensus.cc:2781] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:38:12.251225 23213 raft_consensus.cc:686] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 4 LEADER]: Becoming Leader. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Running, Role: LEADER
I20260807 13:38:12.251972 22828 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7c6d56e133e448138b6424f52ae64c02"
dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
mode: GRACEFUL
new_leader_uuid: "372a4f85197e454ca7320876e3b7c4fc"
from {username='slave'} at 127.0.0.1:58384
I20260807 13:38:12.252672 22828 raft_consensus.cc:595] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 2 LEADER]: Received request to transfer leadership to TS 372a4f85197e454ca7320876e3b7c4fc
I20260807 13:38:12.252381 23213 consensus_queue.cc:237] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:12.261587 22587 catalog_manager.cc:5495] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc reported cstate change: term changed from 3 to 4, leader changed from f1b6231195f34d7288d834af49866850 (127.21.69.3) to 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1). New cstate: current_term: 4 leader_uuid: "372a4f85197e454ca7320876e3b7c4fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:12.317277 23210 raft_consensus.cc:979] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765: : Instructing follower 372a4f85197e454ca7320876e3b7c4fc to start an election
I20260807 13:38:12.318066 23228 raft_consensus.cc:1067] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [term 2 LEADER]: Signalling peer 372a4f85197e454ca7320876e3b7c4fc to start an election
I20260807 13:38:12.319865 22725 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "792691555ea442f39ad0f98f9a406618"
dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
from {username='slave'} at 127.0.0.1:60804
I20260807 13:38:12.320330 22725 raft_consensus.cc:482] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:38:12.320583 22725 raft_consensus.cc:3037] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:12.325799 22725 raft_consensus.cc:504] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:12.327378 22725 leader_election.cc:288] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 3 election: Requested vote from peers 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:38:12.328413 22828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "792691555ea442f39ad0f98f9a406618" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
I20260807 13:38:12.328522 22928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "792691555ea442f39ad0f98f9a406618" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f1b6231195f34d7288d834af49866850"
I20260807 13:38:12.329010 22828 raft_consensus.cc:3032] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:38:12.329137 22928 raft_consensus.cc:3037] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:12.329313 22828 raft_consensus.cc:729] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7816d0098bcf407f8a4db491fc5b1765, State: Running, Role: LEADER
I20260807 13:38:12.330150 22828 consensus_queue.cc:260] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:12.331300 22828 raft_consensus.cc:3037] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:12.334591 22928 raft_consensus.cc:2454] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 3.
I20260807 13:38:12.336167 22677 leader_election.cc:302] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc, f1b6231195f34d7288d834af49866850; no voters:
I20260807 13:38:12.337111 23213 raft_consensus.cc:2781] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:12.337566 23213 raft_consensus.cc:686] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [term 3 LEADER]: Becoming Leader. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Running, Role: LEADER
I20260807 13:38:12.337805 22828 raft_consensus.cc:2454] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 3.
I20260807 13:38:12.338442 23213 consensus_queue.cc:237] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:12.346086 22587 catalog_manager.cc:5495] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc reported cstate change: term changed from 2 to 3, leader changed from 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2) to 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1). New cstate: current_term: 3 leader_uuid: "372a4f85197e454ca7320876e3b7c4fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:12.435354 23218 raft_consensus.cc:979] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850: : Instructing follower 372a4f85197e454ca7320876e3b7c4fc to start an election
I20260807 13:38:12.435997 23215 raft_consensus.cc:1067] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [term 2 LEADER]: Signalling peer 372a4f85197e454ca7320876e3b7c4fc to start an election
I20260807 13:38:12.437726 22725 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "292b176c9c8c46d1b74684303c1c9d58"
dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
from {username='slave'} at 127.0.0.1:60814
I20260807 13:38:12.438299 22725 raft_consensus.cc:482] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:38:12.438627 22725 raft_consensus.cc:3037] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:12.444557 22725 raft_consensus.cc:504] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:12.446699 22725 leader_election.cc:288] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 3 election: Requested vote from peers 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:38:12.447620 22828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "292b176c9c8c46d1b74684303c1c9d58" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
I20260807 13:38:12.447935 22928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "292b176c9c8c46d1b74684303c1c9d58" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f1b6231195f34d7288d834af49866850"
I20260807 13:38:12.448269 22828 raft_consensus.cc:3037] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:12.448467 22928 raft_consensus.cc:3032] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:38:12.448798 22928 raft_consensus.cc:729] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f1b6231195f34d7288d834af49866850, State: Running, Role: LEADER
I20260807 13:38:12.449497 22928 consensus_queue.cc:260] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:12.450444 22928 raft_consensus.cc:3037] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:12.453797 22828 raft_consensus.cc:2454] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 3.
I20260807 13:38:12.455193 22676 leader_election.cc:302] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc, 7816d0098bcf407f8a4db491fc5b1765; no voters:
I20260807 13:38:12.455722 22928 raft_consensus.cc:2454] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 3.
I20260807 13:38:12.456210 23213 raft_consensus.cc:2781] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:12.456812 23213 raft_consensus.cc:686] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [term 3 LEADER]: Becoming Leader. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Running, Role: LEADER
I20260807 13:38:12.457816 23213 consensus_queue.cc:237] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:12.465197 22587 catalog_manager.cc:5495] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc reported cstate change: term changed from 2 to 3, leader changed from f1b6231195f34d7288d834af49866850 (127.21.69.3) to 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1). New cstate: current_term: 3 leader_uuid: "372a4f85197e454ca7320876e3b7c4fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:12.577977 23210 raft_consensus.cc:979] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765: : Instructing follower 372a4f85197e454ca7320876e3b7c4fc to start an election
I20260807 13:38:12.578559 23228 raft_consensus.cc:1067] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 2 LEADER]: Signalling peer 372a4f85197e454ca7320876e3b7c4fc to start an election
I20260807 13:38:12.580474 22725 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7c6d56e133e448138b6424f52ae64c02"
dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
from {username='slave'} at 127.0.0.1:60804
I20260807 13:38:12.581010 22725 raft_consensus.cc:482] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:38:12.581327 22725 raft_consensus.cc:3037] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:12.589109 22725 raft_consensus.cc:504] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:12.589888 23210 raft_consensus.cc:979] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765: : Instructing follower 372a4f85197e454ca7320876e3b7c4fc to start an election
I20260807 13:38:12.590425 23228 raft_consensus.cc:1067] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [term 2 LEADER]: Signalling peer 372a4f85197e454ca7320876e3b7c4fc to start an election
I20260807 13:38:12.591174 22725 leader_election.cc:288] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 3 election: Requested vote from peers 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:38:12.592126 22828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c6d56e133e448138b6424f52ae64c02" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
I20260807 13:38:12.592352 22928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c6d56e133e448138b6424f52ae64c02" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f1b6231195f34d7288d834af49866850"
I20260807 13:38:12.592849 22828 raft_consensus.cc:3032] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:38:12.592733 22725 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8078e36e4510492cb458f7f9ec29a87a"
dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
from {username='slave'} at 127.0.0.1:60804
I20260807 13:38:12.592989 22928 raft_consensus.cc:3037] T 7c6d56e133e448138b6424f52ae64c02 P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:12.593261 22828 raft_consensus.cc:729] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7816d0098bcf407f8a4db491fc5b1765, State: Running, Role: LEADER
I20260807 13:38:12.593458 22725 raft_consensus.cc:482] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:38:12.594229 22725 raft_consensus.cc:3037] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:12.594732 22828 consensus_queue.cc:260] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:12.596216 22828 raft_consensus.cc:3037] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:12.598978 22928 raft_consensus.cc:2454] T 7c6d56e133e448138b6424f52ae64c02 P f1b6231195f34d7288d834af49866850 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 3.
I20260807 13:38:12.600136 22677 leader_election.cc:302] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc, f1b6231195f34d7288d834af49866850; no voters:
I20260807 13:38:12.600981 23213 raft_consensus.cc:2781] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:12.601457 23213 raft_consensus.cc:686] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 3 LEADER]: Becoming Leader. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Running, Role: LEADER
I20260807 13:38:12.601807 22725 raft_consensus.cc:504] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:12.602483 23213 consensus_queue.cc:237] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:12.603575 22828 raft_consensus.cc:2454] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 3.
I20260807 13:38:12.603932 22725 leader_election.cc:288] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 3 election: Requested vote from peers 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:38:12.604735 22823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8078e36e4510492cb458f7f9ec29a87a" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
I20260807 13:38:12.605268 22823 raft_consensus.cc:3032] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:38:12.605278 22928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8078e36e4510492cb458f7f9ec29a87a" candidate_uuid: "372a4f85197e454ca7320876e3b7c4fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f1b6231195f34d7288d834af49866850"
I20260807 13:38:12.605635 22823 raft_consensus.cc:729] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7816d0098bcf407f8a4db491fc5b1765, State: Running, Role: LEADER
I20260807 13:38:12.605942 22928 raft_consensus.cc:3037] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:12.606487 22823 consensus_queue.cc:260] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:12.607622 22823 raft_consensus.cc:3037] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:12.615608 22823 raft_consensus.cc:2454] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 3.
I20260807 13:38:12.616168 22928 raft_consensus.cc:2454] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372a4f85197e454ca7320876e3b7c4fc in term 3.
I20260807 13:38:12.615396 22587 catalog_manager.cc:5495] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc reported cstate change: term changed from 2 to 3, leader changed from 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2) to 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1). New cstate: current_term: 3 leader_uuid: "372a4f85197e454ca7320876e3b7c4fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:12.616942 22676 leader_election.cc:302] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372a4f85197e454ca7320876e3b7c4fc, 7816d0098bcf407f8a4db491fc5b1765; no voters:
I20260807 13:38:12.617996 23213 raft_consensus.cc:2781] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:12.618518 23213 raft_consensus.cc:686] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [term 3 LEADER]: Becoming Leader. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Running, Role: LEADER
I20260807 13:38:12.619452 23213 consensus_queue.cc:237] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:12.630677 22587 catalog_manager.cc:5495] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc reported cstate change: term changed from 2 to 3, leader changed from 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2) to 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1). New cstate: current_term: 3 leader_uuid: "372a4f85197e454ca7320876e3b7c4fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:12.694041 22823 raft_consensus.cc:1261] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 4 FOLLOWER]: Refusing update from remote peer 372a4f85197e454ca7320876e3b7c4fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:38:12.695266 23213 consensus_queue.cc:1035] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:38:12.707594 22928 raft_consensus.cc:1261] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 4 FOLLOWER]: Refusing update from remote peer 372a4f85197e454ca7320876e3b7c4fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:38:12.709537 23220 consensus_queue.cc:1035] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:38:12.763254 22823 raft_consensus.cc:1261] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Refusing update from remote peer 372a4f85197e454ca7320876e3b7c4fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:38:12.764654 23220 consensus_queue.cc:1035] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:38:12.777225 22928 raft_consensus.cc:1261] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [term 3 FOLLOWER]: Refusing update from remote peer 372a4f85197e454ca7320876e3b7c4fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:38:12.778841 23220 consensus_queue.cc:1035] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:38:12.842602 22823 raft_consensus.cc:1261] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Refusing update from remote peer 372a4f85197e454ca7320876e3b7c4fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:38:12.843940 23220 consensus_queue.cc:1035] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:38:12.854014 22928 raft_consensus.cc:1261] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [term 3 FOLLOWER]: Refusing update from remote peer 372a4f85197e454ca7320876e3b7c4fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:38:12.855681 23213 consensus_queue.cc:1035] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:38:13.009454 22928 raft_consensus.cc:1261] T 7c6d56e133e448138b6424f52ae64c02 P f1b6231195f34d7288d834af49866850 [term 3 FOLLOWER]: Refusing update from remote peer 372a4f85197e454ca7320876e3b7c4fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:38:13.010830 23240 consensus_queue.cc:1035] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:38:13.021123 22823 raft_consensus.cc:1261] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Refusing update from remote peer 372a4f85197e454ca7320876e3b7c4fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:38:13.022679 23240 consensus_queue.cc:1035] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:38:13.045972 22928 raft_consensus.cc:1261] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850 [term 3 FOLLOWER]: Refusing update from remote peer 372a4f85197e454ca7320876e3b7c4fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:38:13.047364 23240 consensus_queue.cc:1035] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:38:13.048454 22823 raft_consensus.cc:1261] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Refusing update from remote peer 372a4f85197e454ca7320876e3b7c4fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:38:13.049736 23240 consensus_queue.cc:1035] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:38:15.296182 21780 auto_leader_rebalancer-test.cc:373] The leader distribution is
I20260807 13:38:15.297243 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:38:15.305317 22724 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4d1061583ccc4c4eb3f54133ec30ebbb"
dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
mode: GRACEFUL
new_leader_uuid: "7816d0098bcf407f8a4db491fc5b1765"
from {username='slave'} at 127.0.0.1:60842
I20260807 13:38:15.306218 22724 raft_consensus.cc:595] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [term 2 LEADER]: Received request to transfer leadership to TS 7816d0098bcf407f8a4db491fc5b1765
I20260807 13:38:15.309237 22724 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "582d348a46de4d7c9ca05897b09e863f"
dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
mode: GRACEFUL
new_leader_uuid: "f1b6231195f34d7288d834af49866850"
from {username='slave'} at 127.0.0.1:60842
I20260807 13:38:15.309854 22724 raft_consensus.cc:595] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [term 2 LEADER]: Received request to transfer leadership to TS f1b6231195f34d7288d834af49866850
I20260807 13:38:15.312213 22724 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7c6d56e133e448138b6424f52ae64c02"
dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
mode: GRACEFUL
new_leader_uuid: "7816d0098bcf407f8a4db491fc5b1765"
from {username='slave'} at 127.0.0.1:60842
I20260807 13:38:15.312770 22724 raft_consensus.cc:595] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 3 LEADER]: Received request to transfer leadership to TS 7816d0098bcf407f8a4db491fc5b1765
I20260807 13:38:15.315790 22724 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a624e082005541a4b54ff5b7a4dd025e"
dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
mode: GRACEFUL
new_leader_uuid: "f1b6231195f34d7288d834af49866850"
from {username='slave'} at 127.0.0.1:60842
I20260807 13:38:15.316452 22724 raft_consensus.cc:595] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 4 LEADER]: Received request to transfer leadership to TS f1b6231195f34d7288d834af49866850
I20260807 13:38:15.317898 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260807 13:38:15.318563 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:38:15.410512 23220 raft_consensus.cc:979] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc: : Instructing follower 7816d0098bcf407f8a4db491fc5b1765 to start an election
I20260807 13:38:15.411092 23253 raft_consensus.cc:1067] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [term 2 LEADER]: Signalling peer 7816d0098bcf407f8a4db491fc5b1765 to start an election
I20260807 13:38:15.412608 22823 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4d1061583ccc4c4eb3f54133ec30ebbb"
dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
from {username='slave'} at 127.0.0.1:58356
I20260807 13:38:15.413033 22823 raft_consensus.cc:482] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:38:15.413313 22823 raft_consensus.cc:3037] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:15.420450 22823 raft_consensus.cc:504] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:15.422672 22823 leader_election.cc:288] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 3 election: Requested vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:38:15.423761 22724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d1061583ccc4c4eb3f54133ec30ebbb" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
I20260807 13:38:15.424073 22929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d1061583ccc4c4eb3f54133ec30ebbb" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f1b6231195f34d7288d834af49866850"
I20260807 13:38:15.424639 22724 raft_consensus.cc:3032] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:38:15.424695 22929 raft_consensus.cc:3037] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:15.425014 22724 raft_consensus.cc:729] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Running, Role: LEADER
I20260807 13:38:15.425904 22724 consensus_queue.cc:260] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:15.427112 22724 raft_consensus.cc:3037] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:15.431286 22929 raft_consensus.cc:2454] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7816d0098bcf407f8a4db491fc5b1765 in term 3.
I20260807 13:38:15.432855 22783 leader_election.cc:302] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7816d0098bcf407f8a4db491fc5b1765, f1b6231195f34d7288d834af49866850; no voters:
I20260807 13:38:15.433046 22724 raft_consensus.cc:2454] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7816d0098bcf407f8a4db491fc5b1765 in term 3.
I20260807 13:38:15.433921 23228 raft_consensus.cc:2781] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:15.435043 23228 raft_consensus.cc:686] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [term 3 LEADER]: Becoming Leader. State: Replica: 7816d0098bcf407f8a4db491fc5b1765, State: Running, Role: LEADER
I20260807 13:38:15.435990 23228 consensus_queue.cc:237] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:15.444378 22591 catalog_manager.cc:5495] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 reported cstate change: term changed from 2 to 3, leader changed from 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1) to 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2). New cstate: current_term: 3 leader_uuid: "7816d0098bcf407f8a4db491fc5b1765" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:15.592180 23220 raft_consensus.cc:979] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc: : Instructing follower 7816d0098bcf407f8a4db491fc5b1765 to start an election
I20260807 13:38:15.592638 23220 raft_consensus.cc:1067] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 3 LEADER]: Signalling peer 7816d0098bcf407f8a4db491fc5b1765 to start an election
I20260807 13:38:15.594041 22823 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7c6d56e133e448138b6424f52ae64c02"
dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
from {username='slave'} at 127.0.0.1:58356
I20260807 13:38:15.594545 22823 raft_consensus.cc:482] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:38:15.594825 22823 raft_consensus.cc:3037] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:15.600095 22823 raft_consensus.cc:504] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:15.601686 22823 leader_election.cc:288] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 4 election: Requested vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), f1b6231195f34d7288d834af49866850 (127.21.69.3:41343)
I20260807 13:38:15.602640 22929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c6d56e133e448138b6424f52ae64c02" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f1b6231195f34d7288d834af49866850"
I20260807 13:38:15.602602 22724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c6d56e133e448138b6424f52ae64c02" candidate_uuid: "7816d0098bcf407f8a4db491fc5b1765" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
I20260807 13:38:15.603353 22929 raft_consensus.cc:3037] T 7c6d56e133e448138b6424f52ae64c02 P f1b6231195f34d7288d834af49866850 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:15.603386 22724 raft_consensus.cc:3032] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:38:15.603928 22724 raft_consensus.cc:729] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Running, Role: LEADER
I20260807 13:38:15.604858 22724 consensus_queue.cc:260] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:15.606287 22724 raft_consensus.cc:3037] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:15.611472 22929 raft_consensus.cc:2454] T 7c6d56e133e448138b6424f52ae64c02 P f1b6231195f34d7288d834af49866850 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7816d0098bcf407f8a4db491fc5b1765 in term 4.
I20260807 13:38:15.612612 22783 leader_election.cc:302] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7816d0098bcf407f8a4db491fc5b1765, f1b6231195f34d7288d834af49866850; no voters:
I20260807 13:38:15.613392 23228 raft_consensus.cc:2781] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:38:15.613835 23228 raft_consensus.cc:686] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 4 LEADER]: Becoming Leader. State: Replica: 7816d0098bcf407f8a4db491fc5b1765, State: Running, Role: LEADER
I20260807 13:38:15.614073 22724 raft_consensus.cc:2454] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7816d0098bcf407f8a4db491fc5b1765 in term 4.
I20260807 13:38:15.614725 23228 consensus_queue.cc:237] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:15.622594 22591 catalog_manager.cc:5495] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 reported cstate change: term changed from 3 to 4, leader changed from 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1) to 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2). New cstate: current_term: 4 leader_uuid: "7816d0098bcf407f8a4db491fc5b1765" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:15.801723 23253 raft_consensus.cc:979] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc: : Instructing follower f1b6231195f34d7288d834af49866850 to start an election
I20260807 13:38:15.802177 23220 raft_consensus.cc:1067] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [term 2 LEADER]: Signalling peer f1b6231195f34d7288d834af49866850 to start an election
I20260807 13:38:15.803467 22929 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "582d348a46de4d7c9ca05897b09e863f"
dest_uuid: "f1b6231195f34d7288d834af49866850"
from {username='slave'} at 127.0.0.1:53212
I20260807 13:38:15.803992 22929 raft_consensus.cc:482] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:38:15.804339 22929 raft_consensus.cc:3037] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:15.809010 22929 raft_consensus.cc:504] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } }
I20260807 13:38:15.811018 22929 leader_election.cc:288] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 3 election: Requested vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001)
I20260807 13:38:15.812125 22724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "582d348a46de4d7c9ca05897b09e863f" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
I20260807 13:38:15.812145 22823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "582d348a46de4d7c9ca05897b09e863f" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
I20260807 13:38:15.812806 22823 raft_consensus.cc:3037] T 582d348a46de4d7c9ca05897b09e863f P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:15.812779 22724 raft_consensus.cc:3032] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:38:15.813370 22724 raft_consensus.cc:729] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Running, Role: LEADER
I20260807 13:38:15.814124 22724 consensus_queue.cc:260] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } }
I20260807 13:38:15.815142 22724 raft_consensus.cc:3037] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:15.818061 22823 raft_consensus.cc:2454] T 582d348a46de4d7c9ca05897b09e863f P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b6231195f34d7288d834af49866850 in term 3.
I20260807 13:38:15.819453 22878 leader_election.cc:302] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7816d0098bcf407f8a4db491fc5b1765, f1b6231195f34d7288d834af49866850; no voters:
I20260807 13:38:15.820302 22724 raft_consensus.cc:2454] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b6231195f34d7288d834af49866850 in term 3.
I20260807 13:38:15.820381 23215 raft_consensus.cc:2781] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:15.822477 23215 raft_consensus.cc:686] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [term 3 LEADER]: Becoming Leader. State: Replica: f1b6231195f34d7288d834af49866850, State: Running, Role: LEADER
I20260807 13:38:15.823388 23215 consensus_queue.cc:237] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } }
I20260807 13:38:15.831221 22591 catalog_manager.cc:5495] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 reported cstate change: term changed from 2 to 3, leader changed from 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1) to f1b6231195f34d7288d834af49866850 (127.21.69.3). New cstate: current_term: 3 leader_uuid: "f1b6231195f34d7288d834af49866850" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:15.917852 23253 raft_consensus.cc:979] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc: : Instructing follower f1b6231195f34d7288d834af49866850 to start an election
I20260807 13:38:15.918332 23220 raft_consensus.cc:1067] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 4 LEADER]: Signalling peer f1b6231195f34d7288d834af49866850 to start an election
I20260807 13:38:15.919939 22929 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a624e082005541a4b54ff5b7a4dd025e"
dest_uuid: "f1b6231195f34d7288d834af49866850"
from {username='slave'} at 127.0.0.1:53212
I20260807 13:38:15.920567 22929 raft_consensus.cc:482] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:38:15.920984 22929 raft_consensus.cc:3037] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:15.922014 22928 raft_consensus.cc:1261] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [term 3 FOLLOWER]: Refusing update from remote peer 7816d0098bcf407f8a4db491fc5b1765: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:38:15.923277 23228 consensus_queue.cc:1035] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:38:15.927246 22929 raft_consensus.cc:504] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:15.929459 22929 leader_election.cc:288] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 5 election: Requested vote from peers 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643), 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001)
I20260807 13:38:15.930302 22724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a624e082005541a4b54ff5b7a4dd025e" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "372a4f85197e454ca7320876e3b7c4fc"
I20260807 13:38:15.930840 22724 raft_consensus.cc:3032] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:38:15.931100 22823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a624e082005541a4b54ff5b7a4dd025e" candidate_uuid: "f1b6231195f34d7288d834af49866850" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "7816d0098bcf407f8a4db491fc5b1765"
I20260807 13:38:15.931130 22724 raft_consensus.cc:729] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 372a4f85197e454ca7320876e3b7c4fc, State: Running, Role: LEADER
I20260807 13:38:15.931741 22823 raft_consensus.cc:3037] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:15.932160 22724 consensus_queue.cc:260] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:15.933531 22724 raft_consensus.cc:3037] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:15.939615 22823 raft_consensus.cc:2454] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b6231195f34d7288d834af49866850 in term 5.
I20260807 13:38:15.941322 22878 leader_election.cc:302] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7816d0098bcf407f8a4db491fc5b1765, f1b6231195f34d7288d834af49866850; no voters:
I20260807 13:38:15.942314 23215 raft_consensus.cc:2781] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:38:15.942901 23215 raft_consensus.cc:686] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 5 LEADER]: Becoming Leader. State: Replica: f1b6231195f34d7288d834af49866850, State: Running, Role: LEADER
I20260807 13:38:15.943507 22724 raft_consensus.cc:2454] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b6231195f34d7288d834af49866850 in term 5.
I20260807 13:38:15.946686 22725 raft_consensus.cc:1261] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [term 3 FOLLOWER]: Refusing update from remote peer 7816d0098bcf407f8a4db491fc5b1765: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:38:15.944357 23215 consensus_queue.cc:237] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } }
I20260807 13:38:15.951025 23269 consensus_queue.cc:1035] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [LEADER]: Connected to new peer: Peer: permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:38:15.961505 22591 catalog_manager.cc:5495] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 reported cstate change: term changed from 4 to 5, leader changed from 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1) to f1b6231195f34d7288d834af49866850 (127.21.69.3). New cstate: current_term: 5 leader_uuid: "f1b6231195f34d7288d834af49866850" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 } health_report { overall_health: HEALTHY } } }
I20260807 13:38:16.007524 22928 raft_consensus.cc:1261] T 7c6d56e133e448138b6424f52ae64c02 P f1b6231195f34d7288d834af49866850 [term 4 FOLLOWER]: Refusing update from remote peer 7816d0098bcf407f8a4db491fc5b1765: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:38:16.008941 23255 consensus_queue.cc:1035] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1b6231195f34d7288d834af49866850" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 41343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:38:16.023178 22725 raft_consensus.cc:1261] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 4 FOLLOWER]: Refusing update from remote peer 7816d0098bcf407f8a4db491fc5b1765: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:38:16.025195 23255 consensus_queue.cc:1035] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [LEADER]: Connected to new peer: Peer: permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:38:16.210505 22725 raft_consensus.cc:1261] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [term 3 FOLLOWER]: Refusing update from remote peer f1b6231195f34d7288d834af49866850: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:38:16.211848 23215 consensus_queue.cc:1035] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:38:16.221380 22823 raft_consensus.cc:1261] T 582d348a46de4d7c9ca05897b09e863f P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Refusing update from remote peer f1b6231195f34d7288d834af49866850: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:38:16.223215 23215 consensus_queue.cc:1035] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:38:16.319541 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:38:16.325172 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:38:16.325690 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:38:16.358150 22823 raft_consensus.cc:1261] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 5 FOLLOWER]: Refusing update from remote peer f1b6231195f34d7288d834af49866850: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 13:38:16.359781 23263 consensus_queue.cc:1035] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7816d0098bcf407f8a4db491fc5b1765" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 44001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 13:38:16.372205 22725 raft_consensus.cc:1261] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 5 FOLLOWER]: Refusing update from remote peer f1b6231195f34d7288d834af49866850: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 13:38:16.373860 23215 consensus_queue.cc:1035] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [LEADER]: Connected to new peer: Peer: permanent_uuid: "372a4f85197e454ca7320876e3b7c4fc" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 33643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:38:17.326594 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:38:17.332510 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:38:17.333007 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:38:18.334038 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:38:18.340010 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:38:18.340536 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:38:19.341497 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:38:19.346988 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:38:19.347450 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:38:20.348335 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:38:20.353552 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:38:20.354043 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:38:21.355029 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:38:21.360931 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:38:21.361460 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:38:22.362323 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:38:22.367743 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:38:22.368278 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:38:23.369287 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:38:23.375403 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:38:23.375867 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:38:24.460179 21780 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:38:24.465628 21780 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:38:24.466269 21780 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260807 13:38:24.616606 22637 debug-util.cc:398] Leaking SignalData structure 0x7b08001180e0 after lost signal to thread 21785
W20260807 13:38:24.617587 22637 debug-util.cc:398] Leaking SignalData structure 0x7b0800118580 after lost signal to thread 22640
W20260807 13:38:24.618515 22637 debug-util.cc:398] Leaking SignalData structure 0x7b080004eb20 after lost signal to thread 22758
W20260807 13:38:24.619189 22637 debug-util.cc:398] Leaking SignalData structure 0x7b0800119f60 after lost signal to thread 22860
W20260807 13:38:24.619850 22637 debug-util.cc:398] Leaking SignalData structure 0x7b08000d2220 after lost signal to thread 22963
I20260807 13:38:25.499804 21780 auto_leader_rebalancer-test.cc:384] The leader distribution is
I20260807 13:38:25.500815 21780 tablet_server.cc:178] TabletServer@127.21.69.1:0 shutting down...
I20260807 13:38:25.547353 21780 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260807 13:38:25.548270 21780 tablet_replica.cc:330] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc: stopping tablet replica
I20260807 13:38:25.549403 21780 raft_consensus.cc:2229] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [term 3 LEADER]: Raft consensus shutting down.
I20260807 13:38:25.550835 21780 raft_consensus.cc:2258] T 8078e36e4510492cb458f7f9ec29a87a P 372a4f85197e454ca7320876e3b7c4fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.553303 21780 tablet_replica.cc:330] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc: stopping tablet replica
I20260807 13:38:25.553969 21780 raft_consensus.cc:2229] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:38:25.554430 21780 raft_consensus.cc:2258] T 582d348a46de4d7c9ca05897b09e863f P 372a4f85197e454ca7320876e3b7c4fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.556340 21780 tablet_replica.cc:330] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc: stopping tablet replica
I20260807 13:38:25.556957 21780 raft_consensus.cc:2229] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 13:38:25.557462 21780 raft_consensus.cc:2258] T 7c6d56e133e448138b6424f52ae64c02 P 372a4f85197e454ca7320876e3b7c4fc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.559926 21780 tablet_replica.cc:330] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc: stopping tablet replica
I20260807 13:38:25.560451 21780 raft_consensus.cc:2229] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [term 3 LEADER]: Raft consensus shutting down.
I20260807 13:38:25.561478 21780 raft_consensus.cc:2258] T 292b176c9c8c46d1b74684303c1c9d58 P 372a4f85197e454ca7320876e3b7c4fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.563285 21780 tablet_replica.cc:330] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc: stopping tablet replica
I20260807 13:38:25.563870 21780 raft_consensus.cc:2229] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:38:25.564653 21780 raft_consensus.cc:2258] T 4d1061583ccc4c4eb3f54133ec30ebbb P 372a4f85197e454ca7320876e3b7c4fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.567019 21780 tablet_replica.cc:330] T a9540fdebd564c91937a94648f5f07a5 P 372a4f85197e454ca7320876e3b7c4fc: stopping tablet replica
I20260807 13:38:25.567593 21780 raft_consensus.cc:2229] T a9540fdebd564c91937a94648f5f07a5 P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:38:25.568151 21780 raft_consensus.cc:2258] T a9540fdebd564c91937a94648f5f07a5 P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.569975 21780 tablet_replica.cc:330] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc: stopping tablet replica
I20260807 13:38:25.570538 21780 raft_consensus.cc:2229] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260807 13:38:25.571013 21780 raft_consensus.cc:2258] T a624e082005541a4b54ff5b7a4dd025e P 372a4f85197e454ca7320876e3b7c4fc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.572913 21780 tablet_replica.cc:330] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc: stopping tablet replica
I20260807 13:38:25.573475 21780 raft_consensus.cc:2229] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [term 3 LEADER]: Raft consensus shutting down.
I20260807 13:38:25.574378 21780 raft_consensus.cc:2258] T 792691555ea442f39ad0f98f9a406618 P 372a4f85197e454ca7320876e3b7c4fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.576330 21780 tablet_replica.cc:330] T 7f2c02047eb84ad58db0a4e061758163 P 372a4f85197e454ca7320876e3b7c4fc: stopping tablet replica
I20260807 13:38:25.576809 21780 raft_consensus.cc:2229] T 7f2c02047eb84ad58db0a4e061758163 P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:38:25.577255 21780 raft_consensus.cc:2258] T 7f2c02047eb84ad58db0a4e061758163 P 372a4f85197e454ca7320876e3b7c4fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.579195 21780 tablet_replica.cc:330] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc: stopping tablet replica
I20260807 13:38:25.579633 21780 raft_consensus.cc:2229] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [term 2 LEADER]: Raft consensus shutting down.
I20260807 13:38:25.580659 21780 raft_consensus.cc:2258] T eeb3496f0d6c4e8abf2c74435aab93b1 P 372a4f85197e454ca7320876e3b7c4fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.614374 21780 tablet_server.cc:194] TabletServer@127.21.69.1:0 shutdown complete.
I20260807 13:38:25.639497 21780 tablet_server.cc:178] TabletServer@127.21.69.2:0 shutting down...
I20260807 13:38:25.675432 21780 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260807 13:38:25.676476 21780 tablet_replica.cc:330] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765: stopping tablet replica
I20260807 13:38:25.677323 21780 raft_consensus.cc:2229] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 4 LEADER]: Raft consensus shutting down.
I20260807 13:38:25.678728 21780 raft_consensus.cc:2258] T 7c6d56e133e448138b6424f52ae64c02 P 7816d0098bcf407f8a4db491fc5b1765 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260807 13:38:25.679167 22780 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.69.1:33643: connect: Connection refused (error 111) [suppressed 5 similar messages]
I20260807 13:38:25.681795 21780 tablet_replica.cc:330] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765: stopping tablet replica
I20260807 13:38:25.682770 21780 raft_consensus.cc:2229] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765 [term 1 LEADER]: Raft consensus shutting down.
I20260807 13:38:25.684181 21780 raft_consensus.cc:2258] T a9540fdebd564c91937a94648f5f07a5 P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260807 13:38:25.686479 22878 consensus_peers.cc:487] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 -> Peer 7816d0098bcf407f8a4db491fc5b1765 (127.21.69.2:44001): Couldn't send request to peer 7816d0098bcf407f8a4db491fc5b1765. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:38:25.687016 21780 tablet_replica.cc:330] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765: stopping tablet replica
I20260807 13:38:25.687801 21780 raft_consensus.cc:2229] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260807 13:38:25.688346 21780 raft_consensus.cc:2258] T a624e082005541a4b54ff5b7a4dd025e P 7816d0098bcf407f8a4db491fc5b1765 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.690286 21780 tablet_replica.cc:330] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765: stopping tablet replica
I20260807 13:38:25.690830 21780 raft_consensus.cc:2229] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:38:25.691309 21780 raft_consensus.cc:2258] T 8078e36e4510492cb458f7f9ec29a87a P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.693327 21780 tablet_replica.cc:330] T 582d348a46de4d7c9ca05897b09e863f P 7816d0098bcf407f8a4db491fc5b1765: stopping tablet replica
I20260807 13:38:25.693878 21780 raft_consensus.cc:2229] T 582d348a46de4d7c9ca05897b09e863f P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:38:25.694375 21780 raft_consensus.cc:2258] T 582d348a46de4d7c9ca05897b09e863f P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.696455 21780 tablet_replica.cc:330] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765: stopping tablet replica
I20260807 13:38:25.697283 21780 raft_consensus.cc:2229] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:38:25.697942 21780 raft_consensus.cc:2258] T 292b176c9c8c46d1b74684303c1c9d58 P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.700445 21780 tablet_replica.cc:330] T 7f2c02047eb84ad58db0a4e061758163 P 7816d0098bcf407f8a4db491fc5b1765: stopping tablet replica
I20260807 13:38:25.701159 21780 raft_consensus.cc:2229] T 7f2c02047eb84ad58db0a4e061758163 P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:38:25.701718 21780 raft_consensus.cc:2258] T 7f2c02047eb84ad58db0a4e061758163 P 7816d0098bcf407f8a4db491fc5b1765 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.704180 21780 tablet_replica.cc:330] T eeb3496f0d6c4e8abf2c74435aab93b1 P 7816d0098bcf407f8a4db491fc5b1765: stopping tablet replica
I20260807 13:38:25.704866 21780 raft_consensus.cc:2229] T eeb3496f0d6c4e8abf2c74435aab93b1 P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:38:25.705405 21780 raft_consensus.cc:2258] T eeb3496f0d6c4e8abf2c74435aab93b1 P 7816d0098bcf407f8a4db491fc5b1765 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.707751 21780 tablet_replica.cc:330] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765: stopping tablet replica
I20260807 13:38:25.708379 21780 raft_consensus.cc:2229] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:38:25.708952 21780 raft_consensus.cc:2258] T 792691555ea442f39ad0f98f9a406618 P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.711513 21780 tablet_replica.cc:330] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765: stopping tablet replica
I20260807 13:38:25.712131 21780 raft_consensus.cc:2229] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [term 3 LEADER]: Raft consensus shutting down.
I20260807 13:38:25.713043 21780 raft_consensus.cc:2258] T 4d1061583ccc4c4eb3f54133ec30ebbb P 7816d0098bcf407f8a4db491fc5b1765 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.744343 21780 tablet_server.cc:194] TabletServer@127.21.69.2:0 shutdown complete.
I20260807 13:38:25.765463 21780 tablet_server.cc:178] TabletServer@127.21.69.3:0 shutting down...
I20260807 13:38:25.798683 21780 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260807 13:38:25.799465 21780 tablet_replica.cc:330] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850: stopping tablet replica
I20260807 13:38:25.800357 21780 raft_consensus.cc:2229] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 5 LEADER]: Raft consensus shutting down.
I20260807 13:38:25.801411 21780 raft_consensus.cc:2258] T a624e082005541a4b54ff5b7a4dd025e P f1b6231195f34d7288d834af49866850 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.803442 21780 tablet_replica.cc:330] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850: stopping tablet replica
I20260807 13:38:25.804066 21780 raft_consensus.cc:2229] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:38:25.804539 21780 raft_consensus.cc:2258] T 292b176c9c8c46d1b74684303c1c9d58 P f1b6231195f34d7288d834af49866850 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.806391 21780 tablet_replica.cc:330] T a9540fdebd564c91937a94648f5f07a5 P f1b6231195f34d7288d834af49866850: stopping tablet replica
I20260807 13:38:25.806944 21780 raft_consensus.cc:2229] T a9540fdebd564c91937a94648f5f07a5 P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:38:25.807391 21780 raft_consensus.cc:2258] T a9540fdebd564c91937a94648f5f07a5 P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.809789 21780 tablet_replica.cc:330] T 7c6d56e133e448138b6424f52ae64c02 P f1b6231195f34d7288d834af49866850: stopping tablet replica
I20260807 13:38:25.810379 21780 raft_consensus.cc:2229] T 7c6d56e133e448138b6424f52ae64c02 P f1b6231195f34d7288d834af49866850 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 13:38:25.810966 21780 raft_consensus.cc:2258] T 7c6d56e133e448138b6424f52ae64c02 P f1b6231195f34d7288d834af49866850 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.813167 21780 tablet_replica.cc:330] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850: stopping tablet replica
I20260807 13:38:25.813706 21780 raft_consensus.cc:2229] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260807 13:38:25.814172 22877 consensus_peers.cc:487] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850 -> Peer 372a4f85197e454ca7320876e3b7c4fc (127.21.69.1:33643): Couldn't send request to peer 372a4f85197e454ca7320876e3b7c4fc. Status: Network error: Client connection negotiation failed: client connection to 127.21.69.1:33643: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:38:25.814185 21780 raft_consensus.cc:2258] T 8078e36e4510492cb458f7f9ec29a87a P f1b6231195f34d7288d834af49866850 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.816308 21780 tablet_replica.cc:330] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850: stopping tablet replica
I20260807 13:38:25.816855 21780 raft_consensus.cc:2229] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [term 3 LEADER]: Raft consensus shutting down.
I20260807 13:38:25.817749 21780 raft_consensus.cc:2258] T 582d348a46de4d7c9ca05897b09e863f P f1b6231195f34d7288d834af49866850 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.819571 21780 tablet_replica.cc:330] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850: stopping tablet replica
I20260807 13:38:25.820137 21780 raft_consensus.cc:2229] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:38:25.820595 21780 raft_consensus.cc:2258] T 4d1061583ccc4c4eb3f54133ec30ebbb P f1b6231195f34d7288d834af49866850 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.822396 21780 tablet_replica.cc:330] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850: stopping tablet replica
I20260807 13:38:25.822880 21780 raft_consensus.cc:2229] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850 [term 1 LEADER]: Raft consensus shutting down.
I20260807 13:38:25.823825 21780 raft_consensus.cc:2258] T 7f2c02047eb84ad58db0a4e061758163 P f1b6231195f34d7288d834af49866850 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.825838 21780 tablet_replica.cc:330] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850: stopping tablet replica
I20260807 13:38:25.826294 21780 raft_consensus.cc:2229] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:38:25.826779 21780 raft_consensus.cc:2258] T eeb3496f0d6c4e8abf2c74435aab93b1 P f1b6231195f34d7288d834af49866850 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.828511 21780 tablet_replica.cc:330] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850: stopping tablet replica
I20260807 13:38:25.828910 21780 raft_consensus.cc:2229] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:38:25.829330 21780 raft_consensus.cc:2258] T 792691555ea442f39ad0f98f9a406618 P f1b6231195f34d7288d834af49866850 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.890468 21780 tablet_server.cc:194] TabletServer@127.21.69.3:0 shutdown complete.
I20260807 13:38:25.911783 21780 master.cc:537] Master@127.21.69.62:34023 shutting down...
I20260807 13:38:25.939327 21780 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 4a3a89d411ec4c0bb0a327aeee839afc [term 1 LEADER]: Raft consensus shutting down.
I20260807 13:38:25.940094 21780 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 4a3a89d411ec4c0bb0a327aeee839afc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:38:25.940459 21780 tablet_replica.cc:330] T 00000000000000000000000000000000 P 4a3a89d411ec4c0bb0a327aeee839afc: stopping tablet replica
I20260807 13:38:25.993005 21780 master.cc:552] Master@127.21.69.62:34023 shutdown complete.
372a4f85197e454ca7320876e3b7c4fc 5
7816d0098bcf407f8a4db491fc5b1765 4
f1b6231195f34d7288d834af49866850 1
372a4f85197e454ca7320876e3b7c4fc 3
7816d0098bcf407f8a4db491fc5b1765 4
f1b6231195f34d7288d834af49866850 3
372a4f85197e454ca7320876e3b7c4fc 8
7816d0098bcf407f8a4db491fc5b1765 1
f1b6231195f34d7288d834af49866850 1
372a4f85197e454ca7320876e3b7c4fc 4
7816d0098bcf407f8a4db491fc5b1765 3
f1b6231195f34d7288d834af49866850 3
[ OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29209 ms)
[ RUN ] LeaderRebalancerTest.AddTserver
I20260807 13:38:26.041083 21780 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.21.69.62:38269
I20260807 13:38:26.042217 21780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:38:26.048808 23313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:38:26.048784 23314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:38:26.050359 23316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:38:26.052690 21780 server_base.cc:1034] running on GCE node
I20260807 13:38:26.054064 21780 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:38:26.054301 21780 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:38:26.054488 21780 hybrid_clock.cc:648] HybridClock initialized: now 1786109906054460 us; error 0 us; skew 500 ppm
I20260807 13:38:26.055023 21780 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:38:26.062968 21780 webserver.cc:460] Webserver started at http://127.21.69.62:37039/ using document root <none> and password file <none>
I20260807 13:38:26.063535 21780 fs_manager.cc:359] Metadata directory not provided
I20260807 13:38:26.063791 21780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:38:26.064116 21780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:38:26.065462 21780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109844500879-21780-0/minicluster-data/master-0-root/instance:
uuid: "24a5f104316e4154b2778270aa891281"
format_stamp: "Formatted at 2026-08-07 13:38:26 on dist-test-slave-mjjr"
I20260807 13:38:26.070703 21780 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260807 13:38:26.074299 23322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:38:26.075282 21780 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 13:38:26.075752 21780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109844500879-21780-0/minicluster-data/master-0-root
uuid: "24a5f104316e4154b2778270aa891281"
format_stamp: "Formatted at 2026-08-07 13:38:26 on dist-test-slave-mjjr"
I20260807 13:38:26.076331 21780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109844500879-21780-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109844500879-21780-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109844500879-21780-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:38:26.106444 21780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:38:26.107788 21780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:38:26.147802 21780 rpc_server.cc:307] RPC server started. Bound to: 127.21.69.62:38269
I20260807 13:38:26.147848 23392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.69.62:38269 every 8 connection(s)
I20260807 13:38:26.152223 23393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.168154 23393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Bootstrap starting.
I20260807 13:38:26.172924 23393 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:26.177718 23393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: No bootstrap required, opened a new log
I20260807 13:38:26.180260 23393 raft_consensus.cc:348] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24a5f104316e4154b2778270aa891281" member_type: VOTER }
I20260807 13:38:26.180795 23393 raft_consensus.cc:374] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:26.180986 23393 raft_consensus.cc:729] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24a5f104316e4154b2778270aa891281, State: Initialized, Role: FOLLOWER
I20260807 13:38:26.181581 23393 consensus_queue.cc:260] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24a5f104316e4154b2778270aa891281" member_type: VOTER }
I20260807 13:38:26.182034 23393 raft_consensus.cc:388] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 13:38:26.182224 23393 raft_consensus.cc:482] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 13:38:26.182495 23393 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:26.186909 23393 raft_consensus.cc:504] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24a5f104316e4154b2778270aa891281" member_type: VOTER }
I20260807 13:38:26.187414 23393 leader_election.cc:302] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 24a5f104316e4154b2778270aa891281; no voters:
I20260807 13:38:26.188652 23393 leader_election.cc:288] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 13:38:26.189013 23396 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:26.190534 23396 raft_consensus.cc:686] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281 [term 1 LEADER]: Becoming Leader. State: Replica: 24a5f104316e4154b2778270aa891281, State: Running, Role: LEADER
I20260807 13:38:26.191272 23396 consensus_queue.cc:237] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24a5f104316e4154b2778270aa891281" member_type: VOTER }
I20260807 13:38:26.191974 23393 sys_catalog.cc:564] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 13:38:26.197865 23398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 24a5f104316e4154b2778270aa891281. Latest consensus state: current_term: 1 leader_uuid: "24a5f104316e4154b2778270aa891281" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24a5f104316e4154b2778270aa891281" member_type: VOTER } }
I20260807 13:38:26.198163 23397 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "24a5f104316e4154b2778270aa891281" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24a5f104316e4154b2778270aa891281" member_type: VOTER } }
I20260807 13:38:26.198553 23398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281 [sys.catalog]: This master's current role is: LEADER
I20260807 13:38:26.198647 23397 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281 [sys.catalog]: This master's current role is: LEADER
I20260807 13:38:26.200845 23405 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 13:38:26.207238 23405 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 13:38:26.208513 21780 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260807 13:38:26.216112 23405 catalog_manager.cc:1347] Generated new cluster ID: e130480419934a499cbbb89cb022727e
I20260807 13:38:26.216426 23405 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 13:38:26.247794 23405 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 13:38:26.249475 23405 catalog_manager.cc:1504] Loading token signing keys...
I20260807 13:38:26.260291 23405 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Generated new TSK 0
I20260807 13:38:26.261026 23405 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 13:38:26.275279 21780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:38:26.281783 23417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:38:26.282963 23418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:38:26.284447 23420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:38:26.285167 21780 server_base.cc:1034] running on GCE node
I20260807 13:38:26.286201 21780 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:38:26.286379 21780 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:38:26.286589 21780 hybrid_clock.cc:648] HybridClock initialized: now 1786109906286576 us; error 0 us; skew 500 ppm
I20260807 13:38:26.287153 21780 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:38:26.289633 21780 webserver.cc:460] Webserver started at http://127.21.69.1:33795/ using document root <none> and password file <none>
I20260807 13:38:26.290119 21780 fs_manager.cc:359] Metadata directory not provided
I20260807 13:38:26.290313 21780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:38:26.290584 21780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:38:26.291844 21780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109844500879-21780-0/minicluster-data/ts-0-root/instance:
uuid: "e11cad1eeaf5424c94e51241096f6613"
format_stamp: "Formatted at 2026-08-07 13:38:26 on dist-test-slave-mjjr"
I20260807 13:38:26.296986 21780 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 13:38:26.300545 23427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:38:26.301501 21780 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 13:38:26.302377 21780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109844500879-21780-0/minicluster-data/ts-0-root
uuid: "e11cad1eeaf5424c94e51241096f6613"
format_stamp: "Formatted at 2026-08-07 13:38:26 on dist-test-slave-mjjr"
I20260807 13:38:26.302731 21780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109844500879-21780-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109844500879-21780-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109844500879-21780-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:38:26.328096 21780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:38:26.329365 21780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:38:26.330870 21780 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:38:26.333371 21780 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:38:26.333552 21780 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:38:26.333848 21780 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:38:26.334029 21780 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:38:26.377266 21780 rpc_server.cc:307] RPC server started. Bound to: 127.21.69.1:45037
I20260807 13:38:26.377357 23513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.69.1:45037 every 8 connection(s)
I20260807 13:38:26.382351 21780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:38:26.389694 23519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:38:26.390188 23520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:38:26.395157 23523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:38:26.396128 21780 server_base.cc:1034] running on GCE node
I20260807 13:38:26.397639 21780 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:38:26.397921 21780 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:38:26.398100 21780 hybrid_clock.cc:648] HybridClock initialized: now 1786109906398087 us; error 0 us; skew 500 ppm
I20260807 13:38:26.398819 21780 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:38:26.398789 23514 heartbeater.cc:347] Connected to a master server at 127.21.69.62:38269
I20260807 13:38:26.399386 23514 heartbeater.cc:464] Registering TS with master...
I20260807 13:38:26.400249 23514 heartbeater.cc:511] Master 127.21.69.62:38269 requested a full tablet report, sending...
I20260807 13:38:26.402478 23346 ts_manager.cc:194] Registered new tserver with Master: e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037)
I20260807 13:38:26.402556 21780 webserver.cc:460] Webserver started at http://127.21.69.2:35483/ using document root <none> and password file <none>
I20260807 13:38:26.403314 21780 fs_manager.cc:359] Metadata directory not provided
I20260807 13:38:26.403571 21780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:38:26.403901 21780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:38:26.405261 23346 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41372
I20260807 13:38:26.405296 21780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109844500879-21780-0/minicluster-data/ts-1-root/instance:
uuid: "9ae273efd33642ad970ab8d1973917c1"
format_stamp: "Formatted at 2026-08-07 13:38:26 on dist-test-slave-mjjr"
I20260807 13:38:26.410394 21780 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 13:38:26.413771 23531 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:38:26.414557 21780 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 13:38:26.414866 21780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109844500879-21780-0/minicluster-data/ts-1-root
uuid: "9ae273efd33642ad970ab8d1973917c1"
format_stamp: "Formatted at 2026-08-07 13:38:26 on dist-test-slave-mjjr"
I20260807 13:38:26.415167 21780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109844500879-21780-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109844500879-21780-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109844500879-21780-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:38:26.433923 21780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:38:26.435184 21780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:38:26.436762 21780 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:38:26.439023 21780 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:38:26.439262 21780 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:38:26.439595 21780 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:38:26.439854 21780 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260807 13:38:26.484762 21780 rpc_server.cc:307] RPC server started. Bound to: 127.21.69.2:33363
I20260807 13:38:26.484875 23613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.69.2:33363 every 8 connection(s)
I20260807 13:38:26.489792 21780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:38:26.497498 23619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:38:26.498242 23620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:38:26.501706 23625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:38:26.502090 21780 server_base.cc:1034] running on GCE node
I20260807 13:38:26.503525 21780 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:38:26.503854 21780 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:38:26.504063 21780 hybrid_clock.cc:648] HybridClock initialized: now 1786109906504047 us; error 0 us; skew 500 ppm
I20260807 13:38:26.504781 21780 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:38:26.506352 23614 heartbeater.cc:347] Connected to a master server at 127.21.69.62:38269
I20260807 13:38:26.506883 23614 heartbeater.cc:464] Registering TS with master...
I20260807 13:38:26.507799 23614 heartbeater.cc:511] Master 127.21.69.62:38269 requested a full tablet report, sending...
I20260807 13:38:26.507937 21780 webserver.cc:460] Webserver started at http://127.21.69.3:34465/ using document root <none> and password file <none>
I20260807 13:38:26.508544 21780 fs_manager.cc:359] Metadata directory not provided
I20260807 13:38:26.508772 21780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:38:26.509105 21780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:38:26.510151 23346 ts_manager.cc:194] Registered new tserver with Master: 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:26.510346 21780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109844500879-21780-0/minicluster-data/ts-2-root/instance:
uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
format_stamp: "Formatted at 2026-08-07 13:38:26 on dist-test-slave-mjjr"
I20260807 13:38:26.511911 23346 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41376
I20260807 13:38:26.515472 21780 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20260807 13:38:26.519134 23630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:38:26.519981 21780 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260807 13:38:26.520293 21780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109844500879-21780-0/minicluster-data/ts-2-root
uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
format_stamp: "Formatted at 2026-08-07 13:38:26 on dist-test-slave-mjjr"
I20260807 13:38:26.520604 21780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109844500879-21780-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109844500879-21780-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109844500879-21780-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:38:26.535334 21780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:38:26.536688 21780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:38:26.538223 21780 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:38:26.540548 21780 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:38:26.540787 21780 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:38:26.541038 21780 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:38:26.541211 21780 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:38:26.586912 21780 rpc_server.cc:307] RPC server started. Bound to: 127.21.69.3:36765
I20260807 13:38:26.587045 23714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.69.3:36765 every 8 connection(s)
I20260807 13:38:26.604106 23716 heartbeater.cc:347] Connected to a master server at 127.21.69.62:38269
I20260807 13:38:26.604539 23716 heartbeater.cc:464] Registering TS with master...
I20260807 13:38:26.605252 23716 heartbeater.cc:511] Master 127.21.69.62:38269 requested a full tablet report, sending...
I20260807 13:38:26.607256 23346 ts_manager.cc:194] Registered new tserver with Master: 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:26.607625 21780 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017261565s
I20260807 13:38:26.609122 23346 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41390
I20260807 13:38:26.610080 21780 test_util.cc:268] Using random seed: 511928196
I20260807 13:38:26.637547 23346 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41396:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 13:38:26.644586 23346 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 13:38:26.865543 23570 tablet_service.cc:1467] Processing CreateTablet for tablet c8a377464d3c4243989dd0c5f15cd3f1 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260807 13:38:26.867107 23570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8a377464d3c4243989dd0c5f15cd3f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.868691 23669 tablet_service.cc:1467] Processing CreateTablet for tablet bc264e3efe7340e4a63da01f78c1f136 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260807 13:38:26.868896 23567 tablet_service.cc:1467] Processing CreateTablet for tablet bc264e3efe7340e4a63da01f78c1f136 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260807 13:38:26.870179 23669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc264e3efe7340e4a63da01f78c1f136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.870302 23567 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc264e3efe7340e4a63da01f78c1f136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.872882 23566 tablet_service.cc:1467] Processing CreateTablet for tablet e6c49d31823d4cf4adca30ebd1b7eb7e (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260807 13:38:26.874346 23566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6c49d31823d4cf4adca30ebd1b7eb7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.874718 23659 tablet_service.cc:1467] Processing CreateTablet for tablet 448ac0b9f0f0494cbeb234299ad5cc22 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260807 13:38:26.876133 23659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 448ac0b9f0f0494cbeb234299ad5cc22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.876744 23661 tablet_service.cc:1467] Processing CreateTablet for tablet c5654668ae6a4a729bda462319d04c5f (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260807 13:38:26.878262 23661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5654668ae6a4a729bda462319d04c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.877995 23465 tablet_service.cc:1467] Processing CreateTablet for tablet e6c49d31823d4cf4adca30ebd1b7eb7e (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260807 13:38:26.879356 23465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6c49d31823d4cf4adca30ebd1b7eb7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.879586 23468 tablet_service.cc:1467] Processing CreateTablet for tablet c8a377464d3c4243989dd0c5f15cd3f1 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260807 13:38:26.880884 23662 tablet_service.cc:1467] Processing CreateTablet for tablet 9adcbc4da68046a08d0694c794088162 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260807 13:38:26.882289 23662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9adcbc4da68046a08d0694c794088162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.882115 23463 tablet_service.cc:1467] Processing CreateTablet for tablet 3d67ad93011c4a87b0ede6554a1608ce (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260807 13:38:26.884513 23462 tablet_service.cc:1467] Processing CreateTablet for tablet d1bcab9bf8fc4a508a914326892a42a9 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260807 13:38:26.886948 23460 tablet_service.cc:1467] Processing CreateTablet for tablet 9adcbc4da68046a08d0694c794088162 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260807 13:38:26.889534 23458 tablet_service.cc:1467] Processing CreateTablet for tablet c5654668ae6a4a729bda462319d04c5f (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260807 13:38:26.890913 23455 tablet_service.cc:1467] Processing CreateTablet for tablet 2d8b8a0a0e1f4c39b49a8113f26cb278 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260807 13:38:26.891912 23456 tablet_service.cc:1467] Processing CreateTablet for tablet 448ac0b9f0f0494cbeb234299ad5cc22 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260807 13:38:26.880899 23464 tablet_service.cc:1467] Processing CreateTablet for tablet f4746a12996c4987a582df9f569b3c66 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260807 13:38:26.895457 23565 tablet_service.cc:1467] Processing CreateTablet for tablet f4746a12996c4987a582df9f569b3c66 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260807 13:38:26.896973 23565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4746a12996c4987a582df9f569b3c66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.897795 23665 tablet_service.cc:1467] Processing CreateTablet for tablet f4746a12996c4987a582df9f569b3c66 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260807 13:38:26.900830 23668 tablet_service.cc:1467] Processing CreateTablet for tablet e6c49d31823d4cf4adca30ebd1b7eb7e (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260807 13:38:26.901234 23561 tablet_service.cc:1467] Processing CreateTablet for tablet c5654668ae6a4a729bda462319d04c5f (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260807 13:38:26.902129 23665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4746a12996c4987a582df9f569b3c66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.902580 23561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5654668ae6a4a729bda462319d04c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.903255 23663 tablet_service.cc:1467] Processing CreateTablet for tablet d1bcab9bf8fc4a508a914326892a42a9 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260807 13:38:26.904629 23663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1bcab9bf8fc4a508a914326892a42a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.905462 23559 tablet_service.cc:1467] Processing CreateTablet for tablet 2d8b8a0a0e1f4c39b49a8113f26cb278 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260807 13:38:26.906873 23559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d8b8a0a0e1f4c39b49a8113f26cb278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.908689 23560 tablet_service.cc:1467] Processing CreateTablet for tablet 448ac0b9f0f0494cbeb234299ad5cc22 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260807 13:38:26.910164 23560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 448ac0b9f0f0494cbeb234299ad5cc22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.911475 23664 tablet_service.cc:1467] Processing CreateTablet for tablet 3d67ad93011c4a87b0ede6554a1608ce (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260807 13:38:26.908690 23562 tablet_service.cc:1467] Processing CreateTablet for tablet 9adcbc4da68046a08d0694c794088162 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260807 13:38:26.912946 23562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9adcbc4da68046a08d0694c794088162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.909807 23670 tablet_service.cc:1467] Processing CreateTablet for tablet c8a377464d3c4243989dd0c5f15cd3f1 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260807 13:38:26.876744 23467 tablet_service.cc:1467] Processing CreateTablet for tablet bc264e3efe7340e4a63da01f78c1f136 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260807 13:38:26.897532 23563 tablet_service.cc:1467] Processing CreateTablet for tablet d1bcab9bf8fc4a508a914326892a42a9 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260807 13:38:26.915658 23564 tablet_service.cc:1467] Processing CreateTablet for tablet 3d67ad93011c4a87b0ede6554a1608ce (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260807 13:38:26.916940 23458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5654668ae6a4a729bda462319d04c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.918967 23657 tablet_service.cc:1467] Processing CreateTablet for tablet 2d8b8a0a0e1f4c39b49a8113f26cb278 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260807 13:38:26.919833 23468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8a377464d3c4243989dd0c5f15cd3f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.921254 23463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d67ad93011c4a87b0ede6554a1608ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.923032 23467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc264e3efe7340e4a63da01f78c1f136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.921952 23563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1bcab9bf8fc4a508a914326892a42a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.923704 23464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4746a12996c4987a582df9f569b3c66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.926966 23462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1bcab9bf8fc4a508a914326892a42a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.912947 23664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d67ad93011c4a87b0ede6554a1608ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.928661 23456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 448ac0b9f0f0494cbeb234299ad5cc22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.929580 23670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8a377464d3c4243989dd0c5f15cd3f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.932005 23657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d8b8a0a0e1f4c39b49a8113f26cb278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.932402 23460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9adcbc4da68046a08d0694c794088162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.932044 23564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d67ad93011c4a87b0ede6554a1608ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.936133 23668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6c49d31823d4cf4adca30ebd1b7eb7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:26.944098 23455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d8b8a0a0e1f4c39b49a8113f26cb278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.018953 23464 tablet_service.cc:1467] Processing CreateTablet for tablet 5164c8847c724b03bb6c8d0ba41d9535 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260807 13:38:27.020942 23464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5164c8847c724b03bb6c8d0ba41d9535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.042425 23664 tablet_service.cc:1467] Processing CreateTablet for tablet 5164c8847c724b03bb6c8d0ba41d9535 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260807 13:38:27.046307 23661 tablet_service.cc:1467] Processing CreateTablet for tablet 8cd7bd21d1d04883878a334d64e518e3 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260807 13:38:27.048246 23664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5164c8847c724b03bb6c8d0ba41d9535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.060434 23669 tablet_service.cc:1467] Processing CreateTablet for tablet f7572ca9ba3b47978ecbc11a3ed09244 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260807 13:38:27.079952 23737 tablet_bootstrap.cc:492] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:27.096678 23739 tablet_bootstrap.cc:492] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:27.098686 23657 tablet_service.cc:1467] Processing CreateTablet for tablet 28395e0788e4418291f95845e9d5e793 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260807 13:38:27.075202 23661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cd7bd21d1d04883878a334d64e518e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.102293 23659 tablet_service.cc:1467] Processing CreateTablet for tablet a08c7e6c1b31456ea804d5ecdf2a5b70 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260807 13:38:27.047061 23467 tablet_service.cc:1467] Processing CreateTablet for tablet 8cd7bd21d1d04883878a334d64e518e3 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260807 13:38:27.114223 23467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cd7bd21d1d04883878a334d64e518e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.114864 23670 tablet_service.cc:1467] Processing CreateTablet for tablet b6646e8113874345a9835c8fce2e0c51 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260807 13:38:27.116436 23465 tablet_service.cc:1467] Processing CreateTablet for tablet f7572ca9ba3b47978ecbc11a3ed09244 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260807 13:38:27.119071 23455 tablet_service.cc:1467] Processing CreateTablet for tablet 622dda6b9b914746953c43538b53bb7e (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260807 13:38:27.136634 23663 tablet_service.cc:1467] Processing CreateTablet for tablet 622dda6b9b914746953c43538b53bb7e (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260807 13:38:27.122313 23566 tablet_service.cc:1467] Processing CreateTablet for tablet 5164c8847c724b03bb6c8d0ba41d9535 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260807 13:38:27.140650 23562 tablet_service.cc:1467] Processing CreateTablet for tablet 8cd7bd21d1d04883878a334d64e518e3 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260807 13:38:27.144212 23566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5164c8847c724b03bb6c8d0ba41d9535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.123029 23460 tablet_service.cc:1467] Processing CreateTablet for tablet 28395e0788e4418291f95845e9d5e793 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260807 13:38:27.124127 23465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7572ca9ba3b47978ecbc11a3ed09244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.151714 23455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 622dda6b9b914746953c43538b53bb7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.125737 23668 tablet_service.cc:1467] Processing CreateTablet for tablet 647de9e979b94eddb7556f6737c7358b (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260807 13:38:27.130081 23669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7572ca9ba3b47978ecbc11a3ed09244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.152628 23570 tablet_service.cc:1467] Processing CreateTablet for tablet 622dda6b9b914746953c43538b53bb7e (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260807 13:38:27.153788 23659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a08c7e6c1b31456ea804d5ecdf2a5b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.154125 23570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 622dda6b9b914746953c43538b53bb7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.121438 23458 tablet_service.cc:1467] Processing CreateTablet for tablet b6646e8113874345a9835c8fce2e0c51 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260807 13:38:27.166035 23657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28395e0788e4418291f95845e9d5e793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.147246 23561 tablet_service.cc:1467] Processing CreateTablet for tablet f7572ca9ba3b47978ecbc11a3ed09244 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260807 13:38:27.168442 23670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6646e8113874345a9835c8fce2e0c51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.169178 23561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7572ca9ba3b47978ecbc11a3ed09244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.173225 23663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 622dda6b9b914746953c43538b53bb7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.173763 23562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cd7bd21d1d04883878a334d64e518e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.174063 23668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 647de9e979b94eddb7556f6737c7358b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.176720 23460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28395e0788e4418291f95845e9d5e793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.177947 23458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6646e8113874345a9835c8fce2e0c51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.186801 23662 tablet_service.cc:1467] Processing CreateTablet for tablet 70dd63c6fc214c5882dd73c5f05fad72 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260807 13:38:27.196688 23565 tablet_service.cc:1467] Processing CreateTablet for tablet b6646e8113874345a9835c8fce2e0c51 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
W20260807 13:38:27.200623 23323 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 78363.6us
W20260807 13:38:27.201753 23326 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 61115.4us
I20260807 13:38:27.236419 23464 tablet_service.cc:1467] Processing CreateTablet for tablet 4da43081a61b4d25bbd028722bd1223c (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260807 13:38:27.237767 23464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4da43081a61b4d25bbd028722bd1223c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.203979 23740 tablet_bootstrap.cc:492] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
W20260807 13:38:27.211287 23407 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:38:27.218472 23456 tablet_service.cc:1467] Processing CreateTablet for tablet 70dd63c6fc214c5882dd73c5f05fad72 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260807 13:38:27.240031 23456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70dd63c6fc214c5882dd73c5f05fad72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.240362 23463 tablet_service.cc:1467] Processing CreateTablet for tablet a08c7e6c1b31456ea804d5ecdf2a5b70 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260807 13:38:27.241667 23463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a08c7e6c1b31456ea804d5ecdf2a5b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.245398 23737 tablet_bootstrap.cc:654] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:27.248440 23565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6646e8113874345a9835c8fce2e0c51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.256378 23662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70dd63c6fc214c5882dd73c5f05fad72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.258144 23465 tablet_service.cc:1467] Processing CreateTablet for tablet f846254307f64297ae642172f37ab394 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260807 13:38:27.259511 23465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f846254307f64297ae642172f37ab394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.224143 23665 tablet_service.cc:1467] Processing CreateTablet for tablet 4da43081a61b4d25bbd028722bd1223c (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260807 13:38:27.224215 23563 tablet_service.cc:1467] Processing CreateTablet for tablet a08c7e6c1b31456ea804d5ecdf2a5b70 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260807 13:38:27.261996 23563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a08c7e6c1b31456ea804d5ecdf2a5b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.245496 23740 tablet_bootstrap.cc:654] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:27.225730 23739 tablet_bootstrap.cc:654] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:27.266223 23559 tablet_service.cc:1467] Processing CreateTablet for tablet 647de9e979b94eddb7556f6737c7358b (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260807 13:38:27.209057 23462 tablet_service.cc:1467] Processing CreateTablet for tablet 647de9e979b94eddb7556f6737c7358b (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260807 13:38:27.281495 23462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 647de9e979b94eddb7556f6737c7358b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 13:38:27.219816 23324 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 84643us
I20260807 13:38:27.285573 23664 tablet_service.cc:1467] Processing CreateTablet for tablet f846254307f64297ae642172f37ab394 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260807 13:38:27.269294 23665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4da43081a61b4d25bbd028722bd1223c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.269651 23560 tablet_service.cc:1467] Processing CreateTablet for tablet 70dd63c6fc214c5882dd73c5f05fad72 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260807 13:38:27.272420 23566 tablet_service.cc:1467] Processing CreateTablet for tablet 4da43081a61b4d25bbd028722bd1223c (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260807 13:38:27.273243 23564 tablet_service.cc:1467] Processing CreateTablet for tablet f846254307f64297ae642172f37ab394 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260807 13:38:27.271504 23468 tablet_service.cc:1467] Processing CreateTablet for tablet a523d2840d4a4565b8051820b04b147f (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260807 13:38:27.226276 23567 tablet_service.cc:1467] Processing CreateTablet for tablet 28395e0788e4418291f95845e9d5e793 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260807 13:38:27.314625 23739 tablet_bootstrap.cc:492] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:27.314723 23468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a523d2840d4a4565b8051820b04b147f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.281495 23559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 647de9e979b94eddb7556f6737c7358b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.317946 23567 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28395e0788e4418291f95845e9d5e793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.318691 23566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4da43081a61b4d25bbd028722bd1223c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.319308 23560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70dd63c6fc214c5882dd73c5f05fad72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.305047 23740 tablet_bootstrap.cc:492] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:27.321259 23740 ts_tablet_manager.cc:1397] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.118s user 0.013s sys 0.000s
I20260807 13:38:27.325618 23739 ts_tablet_manager.cc:1397] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.229s user 0.012s sys 0.010s
I20260807 13:38:27.326699 23740 raft_consensus.cc:348] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:38:27.327606 23740 raft_consensus.cc:374] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:27.344118 23740 raft_consensus.cc:729] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:27.344640 23739 raft_consensus.cc:348] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:27.345525 23739 raft_consensus.cc:374] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:27.338253 23462 tablet_service.cc:1467] Processing CreateTablet for tablet 173a6c34d23a480793ef93a33940fa0f (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260807 13:38:27.345901 23739 raft_consensus.cc:729] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:27.328438 23564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f846254307f64297ae642172f37ab394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.346849 23462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 173a6c34d23a480793ef93a33940fa0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.346743 23739 consensus_queue.cc:260] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:27.345924 23737 tablet_bootstrap.cc:492] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:27.353040 23737 ts_tablet_manager.cc:1397] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.274s user 0.013s sys 0.008s
I20260807 13:38:27.352713 23740 consensus_queue.cc:260] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:38:27.329730 23456 tablet_service.cc:1467] Processing CreateTablet for tablet 98b1cb53677841e393a54d9204f8959e (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260807 13:38:27.356042 23737 raft_consensus.cc:348] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:27.339576 23664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f846254307f64297ae642172f37ab394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.357129 23456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98b1cb53677841e393a54d9204f8959e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.362869 23737 raft_consensus.cc:374] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:27.375092 23737 raft_consensus.cc:729] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:27.398545 23561 tablet_service.cc:1467] Processing CreateTablet for tablet 173a6c34d23a480793ef93a33940fa0f (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260807 13:38:27.402734 23663 tablet_service.cc:1467] Processing CreateTablet for tablet 98b1cb53677841e393a54d9204f8959e (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260807 13:38:27.402787 23562 tablet_service.cc:1467] Processing CreateTablet for tablet 98b1cb53677841e393a54d9204f8959e (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260807 13:38:27.404337 23737 consensus_queue.cc:260] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:27.408547 23514 heartbeater.cc:503] Master 127.21.69.62:38269 was elected leader, sending a full tablet report...
I20260807 13:38:27.411849 23614 heartbeater.cc:503] Master 127.21.69.62:38269 was elected leader, sending a full tablet report...
I20260807 13:38:27.412585 23663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98b1cb53677841e393a54d9204f8959e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.417733 23669 tablet_service.cc:1467] Processing CreateTablet for tablet 173a6c34d23a480793ef93a33940fa0f (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260807 13:38:27.422778 23669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 173a6c34d23a480793ef93a33940fa0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.423841 23740 ts_tablet_manager.cc:1428] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.102s user 0.008s sys 0.016s
I20260807 13:38:27.420955 23659 tablet_service.cc:1467] Processing CreateTablet for tablet ae09b72e43be4ee7a4c56900f3f31fdb (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260807 13:38:27.380579 23668 tablet_service.cc:1467] Processing CreateTablet for tablet a523d2840d4a4565b8051820b04b147f (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260807 13:38:27.448740 23745 raft_consensus.cc:482] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:27.482622 23662 tablet_service.cc:1467] Processing CreateTablet for tablet a2d9eca137dd4e03bdcaa721491ef3c0 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260807 13:38:27.482566 23745 raft_consensus.cc:504] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:38:27.484150 23716 heartbeater.cc:503] Master 127.21.69.62:38269 was elected leader, sending a full tablet report...
I20260807 13:38:27.485081 23665 tablet_service.cc:1467] Processing CreateTablet for tablet 0e601359a84745c38ae821025d18d881 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260807 13:38:27.490069 23739 ts_tablet_manager.cc:1428] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.164s user 0.024s sys 0.025s
I20260807 13:38:27.490274 23745 leader_election.cc:288] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765), e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037)
I20260807 13:38:27.491060 23739 tablet_bootstrap.cc:492] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:27.504191 23566 tablet_service.cc:1467] Processing CreateTablet for tablet ae09b72e43be4ee7a4c56900f3f31fdb (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260807 13:38:27.443226 23455 tablet_service.cc:1467] Processing CreateTablet for tablet a2d9eca137dd4e03bdcaa721491ef3c0 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260807 13:38:27.517194 23455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2d9eca137dd4e03bdcaa721491ef3c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.427853 23570 tablet_service.cc:1467] Processing CreateTablet for tablet a523d2840d4a4565b8051820b04b147f (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260807 13:38:27.520875 23665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e601359a84745c38ae821025d18d881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.523201 23740 tablet_bootstrap.cc:492] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:27.524827 23662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2d9eca137dd4e03bdcaa721491ef3c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.526712 23659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae09b72e43be4ee7a4c56900f3f31fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.527734 23561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 173a6c34d23a480793ef93a33940fa0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.476812 23458 tablet_service.cc:1467] Processing CreateTablet for tablet 0e601359a84745c38ae821025d18d881 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260807 13:38:27.528947 23458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e601359a84745c38ae821025d18d881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.528880 23661 tablet_service.cc:1467] Processing CreateTablet for tablet b4fca61b91424248bc334d15fc11f82d (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260807 13:38:27.530184 23661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4fca61b91424248bc334d15fc11f82d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.429293 23467 tablet_service.cc:1467] Processing CreateTablet for tablet ae09b72e43be4ee7a4c56900f3f31fdb (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260807 13:38:27.515326 23559 tablet_service.cc:1467] Processing CreateTablet for tablet a2d9eca137dd4e03bdcaa721491ef3c0 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260807 13:38:27.457975 23670 tablet_service.cc:1467] Processing CreateTablet for tablet ea6c8df560094315891e2805f0b21791 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260807 13:38:27.533411 23670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea6c8df560094315891e2805f0b21791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.533697 23563 tablet_service.cc:1467] Processing CreateTablet for tablet ea6c8df560094315891e2805f0b21791 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260807 13:38:27.532459 23467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae09b72e43be4ee7a4c56900f3f31fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.537238 23563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea6c8df560094315891e2805f0b21791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.538053 23562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98b1cb53677841e393a54d9204f8959e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.538749 23566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae09b72e43be4ee7a4c56900f3f31fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.540534 23570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a523d2840d4a4565b8051820b04b147f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.541590 23559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2d9eca137dd4e03bdcaa721491ef3c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.545686 23657 tablet_service.cc:1467] Processing CreateTablet for tablet d36f9c3051e24fba90a7a4418204d381 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260807 13:38:27.547148 23657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d36f9c3051e24fba90a7a4418204d381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.561210 23460 tablet_service.cc:1467] Processing CreateTablet for tablet a42b974d289d402ea12744b7caf94ae8 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260807 13:38:27.562585 23460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a42b974d289d402ea12744b7caf94ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.493059 23463 tablet_service.cc:1467] Processing CreateTablet for tablet b4fca61b91424248bc334d15fc11f82d (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260807 13:38:27.558835 23565 tablet_service.cc:1467] Processing CreateTablet for tablet 0e601359a84745c38ae821025d18d881 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260807 13:38:27.550417 23462 tablet_service.cc:1467] Processing CreateTablet for tablet d36f9c3051e24fba90a7a4418204d381 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260807 13:38:27.574257 23565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e601359a84745c38ae821025d18d881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.578624 23746 raft_consensus.cc:482] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:27.454782 23465 tablet_service.cc:1467] Processing CreateTablet for tablet ea6c8df560094315891e2805f0b21791 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260807 13:38:27.579195 23746 raft_consensus.cc:504] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:27.571632 23463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4fca61b91424248bc334d15fc11f82d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.584609 23746 leader_election.cc:288] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:27.582506 23564 tablet_service.cc:1467] Processing CreateTablet for tablet b4fca61b91424248bc334d15fc11f82d (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260807 13:38:27.601015 23747 raft_consensus.cc:482] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:27.600978 23668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a523d2840d4a4565b8051820b04b147f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.608973 23740 tablet_bootstrap.cc:654] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:27.616904 23465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea6c8df560094315891e2805f0b21791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.638546 23739 tablet_bootstrap.cc:654] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:27.611346 23464 tablet_service.cc:1467] Processing CreateTablet for tablet a1569622b874437badb8e59e749fe7db (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260807 13:38:27.665516 23737 ts_tablet_manager.cc:1428] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.312s user 0.013s sys 0.042s
I20260807 13:38:27.676710 23464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1569622b874437badb8e59e749fe7db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.666791 23564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4fca61b91424248bc334d15fc11f82d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.611419 23747 raft_consensus.cc:504] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:27.701272 23567 tablet_service.cc:1467] Processing CreateTablet for tablet a1569622b874437badb8e59e749fe7db (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260807 13:38:27.712906 23747 leader_election.cc:288] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:27.724568 23567 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1569622b874437badb8e59e749fe7db. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 13:38:27.733234 23326 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 44042.1us
I20260807 13:38:27.741026 23462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d36f9c3051e24fba90a7a4418204d381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.751420 23663 tablet_service.cc:1467] Processing CreateTablet for tablet a42b974d289d402ea12744b7caf94ae8 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260807 13:38:27.752943 23663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a42b974d289d402ea12744b7caf94ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.757580 23740 tablet_bootstrap.cc:492] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:27.758284 23740 ts_tablet_manager.cc:1397] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.258s user 0.028s sys 0.027s
I20260807 13:38:27.762022 23740 raft_consensus.cc:348] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:27.763064 23740 raft_consensus.cc:374] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:27.767889 23737 tablet_bootstrap.cc:492] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:27.710347 23560 tablet_service.cc:1467] Processing CreateTablet for tablet d36f9c3051e24fba90a7a4418204d381 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260807 13:38:27.778978 23560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d36f9c3051e24fba90a7a4418204d381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.763446 23740 raft_consensus.cc:729] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:27.797302 23737 tablet_bootstrap.cc:654] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:27.832705 23739 tablet_bootstrap.cc:492] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:27.833403 23739 ts_tablet_manager.cc:1397] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.343s user 0.012s sys 0.006s
I20260807 13:38:27.853291 23456 tablet_service.cc:1467] Processing CreateTablet for tablet 6b23b4f74b0f41e1920fa0a5b83ed1a1 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260807 13:38:27.855099 23456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b23b4f74b0f41e1920fa0a5b83ed1a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.862416 23565 tablet_service.cc:1467] Processing CreateTablet for tablet 6b23b4f74b0f41e1920fa0a5b83ed1a1 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260807 13:38:27.864423 23565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b23b4f74b0f41e1920fa0a5b83ed1a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.869207 23661 tablet_service.cc:1467] Processing CreateTablet for tablet ad4a1bc9b3a24e2da54bcbdc8ae0b14c (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260807 13:38:27.871170 23661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad4a1bc9b3a24e2da54bcbdc8ae0b14c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.881764 23668 tablet_service.cc:1467] Processing CreateTablet for tablet 6b23b4f74b0f41e1920fa0a5b83ed1a1 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260807 13:38:27.883249 23668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b23b4f74b0f41e1920fa0a5b83ed1a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.891829 23562 tablet_service.cc:1467] Processing CreateTablet for tablet a42b974d289d402ea12744b7caf94ae8 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260807 13:38:27.893785 23562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a42b974d289d402ea12744b7caf94ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.895107 23661 tablet_service.cc:1467] Processing CreateTablet for tablet 944b1327a944412b8ef8b5a60f96fb2d (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260807 13:38:27.909014 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:27.915104 23533 leader_election.cc:341] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:27.919015 23669 tablet_service.cc:1467] Processing CreateTablet for tablet a1569622b874437badb8e59e749fe7db (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260807 13:38:27.920862 23669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1569622b874437badb8e59e749fe7db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.924329 23739 raft_consensus.cc:348] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:27.925340 23739 raft_consensus.cc:374] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:27.925711 23739 raft_consensus.cc:729] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:27.933445 23467 tablet_service.cc:1467] Processing CreateTablet for tablet 8dc332a3eb6042b1ae81daca421463d1 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260807 13:38:27.927410 23565 tablet_service.cc:1467] Processing CreateTablet for tablet 8dc332a3eb6042b1ae81daca421463d1 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260807 13:38:27.935249 23467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dc332a3eb6042b1ae81daca421463d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.936172 23565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dc332a3eb6042b1ae81daca421463d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.953065 23661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 944b1327a944412b8ef8b5a60f96fb2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.933430 23458 tablet_service.cc:1467] Processing CreateTablet for tablet ea167f614ede4fb0b327431be74e98b0 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260807 13:38:27.956985 23458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea167f614ede4fb0b327431be74e98b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.933430 23462 tablet_service.cc:1467] Processing CreateTablet for tablet 944b1327a944412b8ef8b5a60f96fb2d (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260807 13:38:27.972711 23462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 944b1327a944412b8ef8b5a60f96fb2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:27.937707 23740 consensus_queue.cc:260] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:27.963418 23468 tablet_service.cc:1467] Processing CreateTablet for tablet 4c074cd105794bf1a00bd3a9f449a323 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260807 13:38:27.989480 23740 ts_tablet_manager.cc:1428] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.231s user 0.007s sys 0.004s
I20260807 13:38:27.990717 23740 tablet_bootstrap.cc:492] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:27.991014 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:27.992713 23429 leader_election.cc:341] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:28.006160 23657 tablet_service.cc:1467] Processing CreateTablet for tablet 8dc332a3eb6042b1ae81daca421463d1 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260807 13:38:28.009928 23570 tablet_service.cc:1467] Processing CreateTablet for tablet ea167f614ede4fb0b327431be74e98b0 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260807 13:38:27.950172 23739 consensus_queue.cc:260] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.026526 23570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea167f614ede4fb0b327431be74e98b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.021154 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:28.032980 23532 leader_election.cc:341] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:28.033448 23532 leader_election.cc:302] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:28.034667 23745 raft_consensus.cc:2726] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:28.034626 23563 tablet_service.cc:1467] Processing CreateTablet for tablet ad4a1bc9b3a24e2da54bcbdc8ae0b14c (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260807 13:38:28.041735 23664 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57108 (request call id 20) took 1046 ms. Trace:
I20260807 13:38:28.042176 23664 rpcz_store.cc:276] 0807 13:38:26.994912 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:27.284630 (+289718us) service_pool.cc:227] Handling call
0807 13:38:27.333419 (+ 48789us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:38:27.334286 (+ 867us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:38:27.690823 (+356537us) tablet_metadata.cc:641] Metadata flushed
0807 13:38:28.041199 (+350376us) tablet_replica.cc:205] Creating consensus instance
0807 13:38:28.041665 (+ 466us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:28.044963 23665 tablet_service.cc:1467] Processing CreateTablet for tablet 4c074cd105794bf1a00bd3a9f449a323 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260807 13:38:28.046269 23665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c074cd105794bf1a00bd3a9f449a323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.050036 23662 tablet_service.cc:1467] Processing CreateTablet for tablet fcdef01e85a44e1093dd335055986423 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260807 13:38:28.051388 23662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fcdef01e85a44e1093dd335055986423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.052735 23659 tablet_service.cc:1467] Processing CreateTablet for tablet befa4915864b484ebbdf16226fda5bc0 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260807 13:38:28.027824 23739 ts_tablet_manager.cc:1428] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.194s user 0.010s sys 0.000s
I20260807 13:38:28.016721 23468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c074cd105794bf1a00bd3a9f449a323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.030246 23566 tablet_service.cc:1467] Processing CreateTablet for tablet 944b1327a944412b8ef8b5a60f96fb2d (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260807 13:38:28.061744 23455 tablet_service.cc:1467] Processing CreateTablet for tablet fcdef01e85a44e1093dd335055986423 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260807 13:38:28.063158 23455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fcdef01e85a44e1093dd335055986423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.062902 23463 tablet_service.cc:1467] Processing CreateTablet for tablet 98d96e350af14393a80eeb2702230747 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260807 13:38:28.064422 23460 tablet_service.cc:1467] Processing CreateTablet for tablet ad4a1bc9b3a24e2da54bcbdc8ae0b14c (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260807 13:38:28.064841 23458 tablet_service.cc:1467] Processing CreateTablet for tablet befa4915864b484ebbdf16226fda5bc0 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260807 13:38:28.075639 23467 tablet_service.cc:1467] Processing CreateTablet for tablet 11eba6f59d7f4541873d69ef88a0ad93 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260807 13:38:28.076601 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:28.079286 23561 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49032 (request call id 23) took 1034 ms. Trace:
I20260807 13:38:28.079335 23565 tablet_service.cc:1467] Processing CreateTablet for tablet 4c074cd105794bf1a00bd3a9f449a323 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260807 13:38:28.079339 23564 tablet_service.cc:1467] Processing CreateTablet for tablet 98d96e350af14393a80eeb2702230747 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260807 13:38:28.079845 23561 rpcz_store.cc:276] 0807 13:38:27.044717 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:27.376809 (+332092us) service_pool.cc:227] Handling call
0807 13:38:27.474522 (+ 97713us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:38:27.479814 (+ 5292us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:38:27.705301 (+225487us) tablet_metadata.cc:641] Metadata flushed
0807 13:38:28.038145 (+332844us) tablet_replica.cc:205] Creating consensus instance
0807 13:38:28.079224 (+ 41079us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:28.086158 23670 tablet_service.cc:1467] Processing CreateTablet for tablet 98d96e350af14393a80eeb2702230747 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260807 13:38:28.087275 23739 tablet_bootstrap.cc:492] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:28.088423 23464 tablet_service.cc:1467] Processing CreateTablet for tablet 95c5e5bf2dd94ffc98d4ac0c6876c02e (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260807 13:38:28.089826 23561 tablet_service.cc:1467] Processing CreateTablet for tablet fcdef01e85a44e1093dd335055986423 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260807 13:38:28.090981 23462 tablet_service.cc:1467] Processing CreateTablet for tablet ce381b59fcae417a87681d73e12ca9ea (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260807 13:38:28.093478 23566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 944b1327a944412b8ef8b5a60f96fb2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.093500 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:28.095263 23631 leader_election.cc:341] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:28.098516 23737 tablet_bootstrap.cc:492] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:28.099038 23737 ts_tablet_manager.cc:1397] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.355s user 0.021s sys 0.027s
I20260807 13:38:28.102649 23463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98d96e350af14393a80eeb2702230747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.102269 23737 raft_consensus.cc:348] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.103228 23737 raft_consensus.cc:374] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:28.103564 23737 raft_consensus.cc:729] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:28.103988 23458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet befa4915864b484ebbdf16226fda5bc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.104933 23467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11eba6f59d7f4541873d69ef88a0ad93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.105644 23460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad4a1bc9b3a24e2da54bcbdc8ae0b14c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.109653 23462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce381b59fcae417a87681d73e12ca9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.110786 23659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet befa4915864b484ebbdf16226fda5bc0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 13:38:28.111547 23430 leader_election.cc:341] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:28.112071 23430 leader_election.cc:302] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:28.112990 23746 raft_consensus.cc:2726] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:28.104493 23737 consensus_queue.cc:260] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.118450 23664 tablet_service.cc:1467] Processing CreateTablet for tablet ea167f614ede4fb0b327431be74e98b0 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260807 13:38:28.119493 23737 ts_tablet_manager.cc:1428] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.020s user 0.008s sys 0.001s
I20260807 13:38:28.130409 23465 tablet_service.cc:1467] Processing CreateTablet for tablet e20c3c18eb474ef5b19f3300b13b17c3 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260807 13:38:28.132092 23657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dc332a3eb6042b1ae81daca421463d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.154295 23740 tablet_bootstrap.cc:654] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:28.156059 23563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad4a1bc9b3a24e2da54bcbdc8ae0b14c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.164804 23737 tablet_bootstrap.cc:492] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:28.165428 23663 tablet_service.cc:1467] Processing CreateTablet for tablet 11eba6f59d7f4541873d69ef88a0ad93 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260807 13:38:28.166766 23663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11eba6f59d7f4541873d69ef88a0ad93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.167146 23460 tablet_service.cc:1467] Processing CreateTablet for tablet 220c24fa0c52459182e1e89c74331f3b (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260807 13:38:28.172297 23564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98d96e350af14393a80eeb2702230747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.176764 23565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c074cd105794bf1a00bd3a9f449a323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.176508 23570 tablet_service.cc:1467] Processing CreateTablet for tablet 11eba6f59d7f4541873d69ef88a0ad93 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260807 13:38:28.177857 23570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11eba6f59d7f4541873d69ef88a0ad93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.178123 23664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea167f614ede4fb0b327431be74e98b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.184018 23737 tablet_bootstrap.cc:654] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:28.184306 23559 tablet_service.cc:1467] Processing CreateTablet for tablet 95c5e5bf2dd94ffc98d4ac0c6876c02e (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260807 13:38:28.185765 23559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95c5e5bf2dd94ffc98d4ac0c6876c02e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.189646 23567 tablet_service.cc:1467] Processing CreateTablet for tablet ce381b59fcae417a87681d73e12ca9ea (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260807 13:38:28.191000 23567 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce381b59fcae417a87681d73e12ca9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.174135 23462 tablet_service.cc:1467] Processing CreateTablet for tablet 608f7e63bc4648e0890e5f601c52736c (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260807 13:38:28.174353 23562 tablet_service.cc:1467] Processing CreateTablet for tablet befa4915864b484ebbdf16226fda5bc0 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260807 13:38:28.193218 23562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet befa4915864b484ebbdf16226fda5bc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.195909 23458 tablet_service.cc:1467] Processing CreateTablet for tablet 8b6d649ae21a41c9b6723944d7036688 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260807 13:38:28.203048 23665 tablet_service.cc:1467] Processing CreateTablet for tablet 95c5e5bf2dd94ffc98d4ac0c6876c02e (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
W20260807 13:38:28.204334 23717 tablet.cc:2369] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 13:38:28.204984 23665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95c5e5bf2dd94ffc98d4ac0c6876c02e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.208305 23670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98d96e350af14393a80eeb2702230747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.200626 23467 tablet_service.cc:1467] Processing CreateTablet for tablet 4996c3c52ccc41b9a8da11ca747a8e6a (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260807 13:38:28.210644 23561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fcdef01e85a44e1093dd335055986423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.213594 23465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e20c3c18eb474ef5b19f3300b13b17c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.214612 23460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 220c24fa0c52459182e1e89c74331f3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.215504 23462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 608f7e63bc4648e0890e5f601c52736c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.218181 23464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95c5e5bf2dd94ffc98d4ac0c6876c02e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.218994 23467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4996c3c52ccc41b9a8da11ca747a8e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.221146 23458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b6d649ae21a41c9b6723944d7036688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.223910 23463 tablet_service.cc:1467] Processing CreateTablet for tablet b9fcdd060ef64874a8719c95b2325942 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260807 13:38:28.231662 23747 raft_consensus.cc:482] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:28.238194 23747 raft_consensus.cc:504] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:28.241968 23407 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:38:28.242276 23668 tablet_service.cc:1467] Processing CreateTablet for tablet ce381b59fcae417a87681d73e12ca9ea (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260807 13:38:28.246152 23463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9fcdd060ef64874a8719c95b2325942. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.313447 23564 tablet_service.cc:1467] Processing CreateTablet for tablet e20c3c18eb474ef5b19f3300b13b17c3 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260807 13:38:28.287961 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:28.314791 23564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e20c3c18eb474ef5b19f3300b13b17c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.294420 23659 tablet_service.cc:1467] Processing CreateTablet for tablet e20c3c18eb474ef5b19f3300b13b17c3 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260807 13:38:28.316197 23659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e20c3c18eb474ef5b19f3300b13b17c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.295446 23747 leader_election.cc:288] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
W20260807 13:38:28.318252 23631 leader_election.cc:341] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:28.329942 23668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce381b59fcae417a87681d73e12ca9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.306036 23455 tablet_service.cc:1467] Processing CreateTablet for tablet 356c6b3e51454d418acaa9be70bb9689 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260807 13:38:28.333974 23455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 356c6b3e51454d418acaa9be70bb9689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.307338 23560 tablet_service.cc:1467] Processing CreateTablet for tablet 608f7e63bc4648e0890e5f601c52736c (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260807 13:38:28.337072 23560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 608f7e63bc4648e0890e5f601c52736c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.308408 23570 tablet_service.cc:1467] Processing CreateTablet for tablet 220c24fa0c52459182e1e89c74331f3b (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260807 13:38:28.339917 23570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 220c24fa0c52459182e1e89c74331f3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.344687 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:28.345072 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:28.346455 23633 leader_election.cc:341] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:28.347024 23633 leader_election.cc:302] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:28.348471 23747 raft_consensus.cc:2726] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 13:38:28.349702 23633 leader_election.cc:341] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:28.350241 23633 leader_election.cc:302] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:28.351140 23747 raft_consensus.cc:2726] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:28.297423 23739 tablet_bootstrap.cc:654] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:28.392078 23746 raft_consensus.cc:482] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:28.392634 23746 raft_consensus.cc:504] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.393375 23669 tablet_service.cc:1467] Processing CreateTablet for tablet 220c24fa0c52459182e1e89c74331f3b (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260807 13:38:28.394745 23669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 220c24fa0c52459182e1e89c74331f3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.394701 23746 leader_election.cc:288] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:28.396932 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:28.397718 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:28.403074 23429 leader_election.cc:341] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:38:28.404245 23430 leader_election.cc:341] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:28.404696 23430 leader_election.cc:302] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:28.406023 23746 raft_consensus.cc:2726] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 13:38:28.407747 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 58092.2us
I20260807 13:38:28.407470 23565 tablet_service.cc:1467] Processing CreateTablet for tablet 356c6b3e51454d418acaa9be70bb9689 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260807 13:38:28.426783 23737 tablet_bootstrap.cc:492] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:28.420176 23657 tablet_service.cc:1467] Processing CreateTablet for tablet 608f7e63bc4648e0890e5f601c52736c (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260807 13:38:28.434755 23657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 608f7e63bc4648e0890e5f601c52736c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.420181 23661 tablet_service.cc:1467] Processing CreateTablet for tablet 8b6d649ae21a41c9b6723944d7036688 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260807 13:38:28.439338 23661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b6d649ae21a41c9b6723944d7036688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.436285 23737 ts_tablet_manager.cc:1397] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.272s user 0.014s sys 0.009s
I20260807 13:38:28.444419 23740 tablet_bootstrap.cc:492] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:28.444996 23740 ts_tablet_manager.cc:1397] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.454s user 0.018s sys 0.000s
I20260807 13:38:28.445123 23745 raft_consensus.cc:482] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:28.445662 23745 raft_consensus.cc:504] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.449419 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:28.450601 23460 tablet_service.cc:1467] Processing CreateTablet for tablet ea6ae70649fa43bba8052b66977418f5 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260807 13:38:28.451799 23745 leader_election.cc:288] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:28.452224 23458 tablet_service.cc:1467] Processing CreateTablet for tablet faff067df57c4de49e89824bbc248751 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260807 13:38:28.453658 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:28.461133 23662 tablet_service.cc:1467] Processing CreateTablet for tablet 4996c3c52ccc41b9a8da11ca747a8e6a (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260807 13:38:28.463128 23662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4996c3c52ccc41b9a8da11ca747a8e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.453702 23458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet faff067df57c4de49e89824bbc248751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.469906 23740 raft_consensus.cc:348] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.470469 23456 tablet_service.cc:1467] Processing CreateTablet for tablet 05a3da79d3b0447cbc19c4f28279e134 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260807 13:38:28.470983 23740 raft_consensus.cc:374] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:28.472008 23456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05a3da79d3b0447cbc19c4f28279e134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.474656 23562 tablet_service.cc:1467] Processing CreateTablet for tablet 4996c3c52ccc41b9a8da11ca747a8e6a (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260807 13:38:28.478677 23739 tablet_bootstrap.cc:492] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:28.479368 23739 ts_tablet_manager.cc:1397] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.395s user 0.025s sys 0.017s
I20260807 13:38:28.481000 23460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea6ae70649fa43bba8052b66977418f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.483790 23737 raft_consensus.cc:348] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.519984 23737 raft_consensus.cc:374] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:28.520291 23737 raft_consensus.cc:729] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:28.521014 23737 consensus_queue.cc:260] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.523317 23737 ts_tablet_manager.cc:1428] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.082s user 0.003s sys 0.003s
I20260807 13:38:28.434190 23565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 356c6b3e51454d418acaa9be70bb9689. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 13:38:28.451217 23532 leader_election.cc:341] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:28.487618 23468 tablet_service.cc:1467] Processing CreateTablet for tablet 39707c5d97164544b9f5c03db41181c0 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260807 13:38:28.500284 23455 tablet_service.cc:1467] Processing CreateTablet for tablet 46e552e0aa3f4433858116fa31ee8458 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260807 13:38:28.507948 23657 tablet_service.cc:1467] Processing CreateTablet for tablet b9fcdd060ef64874a8719c95b2325942 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260807 13:38:28.525991 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 74819.6us
I20260807 13:38:28.526634 23657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9fcdd060ef64874a8719c95b2325942. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 13:38:28.527987 23533 leader_election.cc:341] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:28.530200 23563 tablet_service.cc:1467] Processing CreateTablet for tablet b9fcdd060ef64874a8719c95b2325942 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260807 13:38:28.506664 23462 tablet_service.cc:1467] Processing CreateTablet for tablet 7cd369f3fbdf4b61a5fd1e85690c9ba4 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260807 13:38:28.533881 23567 tablet_service.cc:1467] Processing CreateTablet for tablet 05a3da79d3b0447cbc19c4f28279e134 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260807 13:38:28.447525 23566 tablet_service.cc:1467] Processing CreateTablet for tablet 8b6d649ae21a41c9b6723944d7036688 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260807 13:38:28.538203 23665 tablet_service.cc:1467] Processing CreateTablet for tablet 356c6b3e51454d418acaa9be70bb9689 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260807 13:38:28.471392 23740 raft_consensus.cc:729] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:28.540517 23737 tablet_bootstrap.cc:492] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:28.541007 23740 consensus_queue.cc:260] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.511940 23467 tablet_service.cc:1467] Processing CreateTablet for tablet b078a19f38494b04ad11b14d98ec4bca (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260807 13:38:28.543555 23740 ts_tablet_manager.cc:1428] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.098s user 0.008s sys 0.000s
I20260807 13:38:28.546415 23740 tablet_bootstrap.cc:492] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:28.514300 23465 tablet_service.cc:1467] Processing CreateTablet for tablet 2b1542e790794928a76e4b29a1d7732b (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260807 13:38:28.531541 23533 leader_election.cc:302] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:28.561481 23468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39707c5d97164544b9f5c03db41181c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.562340 23560 tablet_service.cc:1467] Processing CreateTablet for tablet b078a19f38494b04ad11b14d98ec4bca (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260807 13:38:28.564198 23745 raft_consensus.cc:2726] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:28.519261 23739 raft_consensus.cc:348] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.565341 23563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9fcdd060ef64874a8719c95b2325942. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.568130 23455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46e552e0aa3f4433858116fa31ee8458. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.568691 23567 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05a3da79d3b0447cbc19c4f28279e134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.570458 23566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b6d649ae21a41c9b6723944d7036688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.571954 23560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b078a19f38494b04ad11b14d98ec4bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.570384 23570 tablet_service.cc:1467] Processing CreateTablet for tablet faff067df57c4de49e89824bbc248751 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260807 13:38:28.582697 23668 tablet_service.cc:1467] Processing CreateTablet for tablet 05a3da79d3b0447cbc19c4f28279e134 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260807 13:38:28.584254 23668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05a3da79d3b0447cbc19c4f28279e134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.573681 23559 tablet_service.cc:1467] Processing CreateTablet for tablet 39707c5d97164544b9f5c03db41181c0 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
W20260807 13:38:28.575831 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 119757us
I20260807 13:38:28.573812 23462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cd369f3fbdf4b61a5fd1e85690c9ba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.592058 23467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b078a19f38494b04ad11b14d98ec4bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.566044 23739 raft_consensus.cc:374] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:28.596212 23465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b1542e790794928a76e4b29a1d7732b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.602800 23657 tablet_service.cc:1467] Processing CreateTablet for tablet b078a19f38494b04ad11b14d98ec4bca (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260807 13:38:28.603118 23564 tablet_service.cc:1467] Processing CreateTablet for tablet 46e552e0aa3f4433858116fa31ee8458 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260807 13:38:28.604099 23559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39707c5d97164544b9f5c03db41181c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.605217 23562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4996c3c52ccc41b9a8da11ca747a8e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.612584 23661 tablet_service.cc:1467] Processing CreateTablet for tablet ea6ae70649fa43bba8052b66977418f5 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260807 13:38:28.616358 23570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet faff067df57c4de49e89824bbc248751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.618106 23561 tablet_service.cc:1467] Processing CreateTablet for tablet ea6ae70649fa43bba8052b66977418f5 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260807 13:38:28.619547 23561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea6ae70649fa43bba8052b66977418f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.595371 23739 raft_consensus.cc:729] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:28.622606 23739 consensus_queue.cc:260] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.591421 23663 tablet_service.cc:1467] Processing CreateTablet for tablet faff067df57c4de49e89824bbc248751 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260807 13:38:28.626210 23739 ts_tablet_manager.cc:1428] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.110s user 0.002s sys 0.005s
I20260807 13:38:28.626654 23565 tablet_service.cc:1467] Processing CreateTablet for tablet 7cd369f3fbdf4b61a5fd1e85690c9ba4 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260807 13:38:28.630862 23747 raft_consensus.cc:482] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:28.631364 23747 raft_consensus.cc:504] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.633621 23747 leader_election.cc:288] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:28.629433 23665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 356c6b3e51454d418acaa9be70bb9689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.631415 23670 tablet_service.cc:1467] Processing CreateTablet for tablet 46e552e0aa3f4433858116fa31ee8458 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260807 13:38:28.637286 23564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46e552e0aa3f4433858116fa31ee8458. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.640823 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:28.641047 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:28.642602 23631 leader_election.cc:341] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:28.643833 23657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b078a19f38494b04ad11b14d98ec4bca. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 13:38:28.646394 23633 leader_election.cc:341] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:28.647084 23633 leader_election.cc:302] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:28.648806 23740 tablet_bootstrap.cc:654] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:28.651822 23747 raft_consensus.cc:2726] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:28.653591 23661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea6ae70649fa43bba8052b66977418f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.664826 23659 tablet_service.cc:1467] Processing CreateTablet for tablet 7cd369f3fbdf4b61a5fd1e85690c9ba4 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260807 13:38:28.666258 23659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cd369f3fbdf4b61a5fd1e85690c9ba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.668322 23670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46e552e0aa3f4433858116fa31ee8458. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.672658 23663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet faff067df57c4de49e89824bbc248751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.679566 23737 tablet_bootstrap.cc:654] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:28.684798 23664 tablet_service.cc:1467] Processing CreateTablet for tablet 39707c5d97164544b9f5c03db41181c0 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260807 13:38:28.686236 23664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39707c5d97164544b9f5c03db41181c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.687867 23565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cd369f3fbdf4b61a5fd1e85690c9ba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.694732 23669 tablet_service.cc:1467] Processing CreateTablet for tablet 2b1542e790794928a76e4b29a1d7732b (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260807 13:38:28.705839 23740 tablet_bootstrap.cc:492] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:28.706425 23740 ts_tablet_manager.cc:1397] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.160s user 0.011s sys 0.003s
I20260807 13:38:28.707978 23669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b1542e790794928a76e4b29a1d7732b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.709381 23566 tablet_service.cc:1467] Processing CreateTablet for tablet 2b1542e790794928a76e4b29a1d7732b (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260807 13:38:28.714188 23740 raft_consensus.cc:348] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.715082 23740 raft_consensus.cc:374] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:28.715404 23740 raft_consensus.cc:729] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:28.721168 23739 tablet_bootstrap.cc:492] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:28.721671 23566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b1542e790794928a76e4b29a1d7732b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:38:28.722736 23740 consensus_queue.cc:260] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.738106 23740 ts_tablet_manager.cc:1428] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.031s user 0.003s sys 0.007s
I20260807 13:38:28.740676 23739 tablet_bootstrap.cc:654] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:28.753463 23739 tablet_bootstrap.cc:492] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:28.754109 23739 ts_tablet_manager.cc:1397] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.033s user 0.017s sys 0.005s
I20260807 13:38:28.757078 23739 raft_consensus.cc:348] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.757813 23746 raft_consensus.cc:482] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:28.758127 23739 raft_consensus.cc:374] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:28.758582 23739 raft_consensus.cc:729] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:28.758334 23746 raft_consensus.cc:504] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.759833 23740 tablet_bootstrap.cc:492] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:28.759548 23739 consensus_queue.cc:260] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.760617 23746 leader_election.cc:288] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:28.761955 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:28.763429 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:28.764170 23581 raft_consensus.cc:2454] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
W20260807 13:38:28.765986 23429 leader_election.cc:341] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:28.766978 23430 leader_election.cc:302] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:28.768313 23746 raft_consensus.cc:2781] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:28.768765 23746 raft_consensus.cc:482] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:28.769173 23746 raft_consensus.cc:3037] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:28.773365 23740 tablet_bootstrap.cc:654] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:28.778049 23746 raft_consensus.cc:504] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.781534 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:28.782186 23581 raft_consensus.cc:3037] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:28.785115 23737 tablet_bootstrap.cc:492] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:28.785699 23737 ts_tablet_manager.cc:1397] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.246s user 0.010s sys 0.003s
I20260807 13:38:28.788641 23737 raft_consensus.cc:348] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:38:28.789506 23737 raft_consensus.cc:374] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:28.789921 23737 raft_consensus.cc:729] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:28.790279 23581 raft_consensus.cc:2454] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:28.791484 23430 leader_election.cc:302] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:28.793087 23737 consensus_queue.cc:260] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:38:28.793419 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
W20260807 13:38:28.796514 23429 leader_election.cc:341] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:28.794279 23746 leader_election.cc:288] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:28.804654 23746 raft_consensus.cc:2781] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:28.805159 23746 raft_consensus.cc:686] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:28.805860 23746 consensus_queue.cc:237] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.812966 23737 ts_tablet_manager.cc:1428] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.027s user 0.005s sys 0.001s
I20260807 13:38:28.814102 23737 tablet_bootstrap.cc:492] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:28.815943 23740 tablet_bootstrap.cc:492] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:28.816540 23740 ts_tablet_manager.cc:1397] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.057s user 0.010s sys 0.019s
I20260807 13:38:28.819576 23740 raft_consensus.cc:348] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.820480 23740 raft_consensus.cc:374] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:28.820779 23740 raft_consensus.cc:729] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:28.821174 23739 ts_tablet_manager.cc:1428] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.067s user 0.009s sys 0.000s
I20260807 13:38:28.821590 23740 consensus_queue.cc:260] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.822281 23739 tablet_bootstrap.cc:492] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:28.824541 23740 ts_tablet_manager.cc:1428] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.008s user 0.001s sys 0.005s
I20260807 13:38:28.826320 23740 tablet_bootstrap.cc:492] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:28.831135 23739 tablet_bootstrap.cc:654] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:28.832993 23737 tablet_bootstrap.cc:654] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:28.833038 23740 tablet_bootstrap.cc:654] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:28.846663 23746 raft_consensus.cc:482] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:28.847246 23746 raft_consensus.cc:504] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.848241 23739 tablet_bootstrap.cc:492] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:28.848308 23740 tablet_bootstrap.cc:492] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:28.848879 23739 ts_tablet_manager.cc:1397] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.027s user 0.017s sys 0.000s
I20260807 13:38:28.850245 23746 leader_election.cc:288] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:28.850276 23346 catalog_manager.cc:5495] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 0 to 1, leader changed from <none> to e11cad1eeaf5424c94e51241096f6613 (127.21.69.1). New cstate: current_term: 1 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:28.851146 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:28.850291 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:28.848932 23740 ts_tablet_manager.cc:1397] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.023s user 0.011s sys 0.011s
I20260807 13:38:28.853211 23581 raft_consensus.cc:2454] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:38:28.853650 23739 raft_consensus.cc:348] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.854645 23739 raft_consensus.cc:374] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:28.854993 23739 raft_consensus.cc:729] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:28.854977 23430 leader_election.cc:302] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:28.856240 23739 consensus_queue.cc:260] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:28.857049 23429 leader_election.cc:341] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:28.857656 23774 raft_consensus.cc:2781] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:28.858103 23774 raft_consensus.cc:482] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:28.858472 23774 raft_consensus.cc:3037] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:28.858889 23739 ts_tablet_manager.cc:1428] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260807 13:38:28.859058 23737 tablet_bootstrap.cc:492] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:28.856429 23740 raft_consensus.cc:348] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.859545 23737 ts_tablet_manager.cc:1397] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.046s user 0.015s sys 0.003s
I20260807 13:38:28.859827 23740 raft_consensus.cc:374] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:28.860162 23740 raft_consensus.cc:729] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:28.860982 23740 consensus_queue.cc:260] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.862659 23737 raft_consensus.cc:348] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.863432 23740 ts_tablet_manager.cc:1428] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.010s user 0.003s sys 0.001s
I20260807 13:38:28.863484 23737 raft_consensus.cc:374] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:28.864275 23739 tablet_bootstrap.cc:492] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:28.863924 23737 raft_consensus.cc:729] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:28.865262 23737 consensus_queue.cc:260] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.866007 23774 raft_consensus.cc:504] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.867770 23737 ts_tablet_manager.cc:1428] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260807 13:38:28.868218 23774 leader_election.cc:288] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:28.870656 23737 tablet_bootstrap.cc:492] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:28.870563 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:28.871394 23739 tablet_bootstrap.cc:654] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:28.876797 23740 tablet_bootstrap.cc:492] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:28.877969 23737 tablet_bootstrap.cc:654] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:28.880335 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:28.881079 23581 raft_consensus.cc:3037] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:38:28.884325 23429 leader_election.cc:341] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:28.886036 23740 tablet_bootstrap.cc:654] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:28.894902 23581 raft_consensus.cc:2454] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:28.896898 23430 leader_election.cc:302] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:28.898125 23774 raft_consensus.cc:2781] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:28.898587 23774 raft_consensus.cc:686] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:28.899442 23774 consensus_queue.cc:237] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.903301 23740 tablet_bootstrap.cc:492] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:28.903863 23740 ts_tablet_manager.cc:1397] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.027s user 0.018s sys 0.001s
I20260807 13:38:28.905718 23737 tablet_bootstrap.cc:492] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:28.906311 23737 ts_tablet_manager.cc:1397] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.036s user 0.015s sys 0.013s
I20260807 13:38:28.914978 23740 raft_consensus.cc:348] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.915844 23740 raft_consensus.cc:374] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:28.916128 23740 raft_consensus.cc:729] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:28.918143 23739 tablet_bootstrap.cc:492] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:28.918833 23739 ts_tablet_manager.cc:1397] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.055s user 0.004s sys 0.022s
I20260807 13:38:28.920487 23737 raft_consensus.cc:348] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.921370 23737 raft_consensus.cc:374] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:28.921084 23740 consensus_queue.cc:260] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.921715 23737 raft_consensus.cc:729] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:28.921744 23739 raft_consensus.cc:348] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.922648 23739 raft_consensus.cc:374] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:28.922974 23739 raft_consensus.cc:729] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:28.922750 23737 consensus_queue.cc:260] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.923931 23740 ts_tablet_manager.cc:1428] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.020s user 0.006s sys 0.002s
I20260807 13:38:28.923928 23739 consensus_queue.cc:260] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.925091 23740 tablet_bootstrap.cc:492] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:28.925806 23737 ts_tablet_manager.cc:1428] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.013s user 0.007s sys 0.000s
I20260807 13:38:28.926920 23737 tablet_bootstrap.cc:492] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:28.927103 23739 ts_tablet_manager.cc:1428] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260807 13:38:28.928225 23739 tablet_bootstrap.cc:492] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:28.932616 23740 tablet_bootstrap.cc:654] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:28.934629 23739 tablet_bootstrap.cc:654] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:28.934758 23737 tablet_bootstrap.cc:654] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:28.940148 23774 raft_consensus.cc:482] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:28.940662 23774 raft_consensus.cc:504] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.942704 23774 leader_election.cc:288] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:28.944852 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:28.945552 23684 raft_consensus.cc:2454] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:38:28.946972 23429 leader_election.cc:302] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:28.947166 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:28.947496 23745 raft_consensus.cc:482] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:28.947824 23774 raft_consensus.cc:2781] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:28.948223 23774 raft_consensus.cc:482] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:28.947986 23745 raft_consensus.cc:504] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.948644 23774 raft_consensus.cc:3037] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:38:28.948786 23430 leader_election.cc:341] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:28.950132 23745 leader_election.cc:288] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:28.950574 23739 tablet_bootstrap.cc:492] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:28.951048 23739 ts_tablet_manager.cc:1397] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.023s user 0.012s sys 0.000s
I20260807 13:38:28.951380 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:28.951773 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:28.952409 23481 raft_consensus.cc:2454] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:28.952616 23740 tablet_bootstrap.cc:492] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
W20260807 13:38:28.952976 23533 leader_election.cc:341] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:28.953105 23740 ts_tablet_manager.cc:1397] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.011s
I20260807 13:38:28.953612 23532 leader_election.cc:302] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:28.954444 23745 raft_consensus.cc:2781] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:28.954865 23745 raft_consensus.cc:482] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:28.955253 23745 raft_consensus.cc:3037] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:28.957181 23739 raft_consensus.cc:348] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.957528 23774 raft_consensus.cc:504] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.957959 23739 raft_consensus.cc:374] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:28.958230 23737 tablet_bootstrap.cc:492] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:28.958249 23739 raft_consensus.cc:729] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:28.959590 23774 leader_election.cc:288] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:28.959553 23740 raft_consensus.cc:348] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.961202 23794 raft_consensus.cc:482] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:28.961433 23740 raft_consensus.cc:374] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:28.961771 23740 raft_consensus.cc:729] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:28.961812 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:28.959734 23739 consensus_queue.cc:260] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.962550 23684 raft_consensus.cc:3037] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:28.962329 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:28.963208 23740 consensus_queue.cc:260] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:28.963953 23430 leader_election.cc:341] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:28.965179 23739 ts_tablet_manager.cc:1428] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.011s user 0.007s sys 0.000s
I20260807 13:38:28.966174 23739 tablet_bootstrap.cc:492] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:28.970578 23745 raft_consensus.cc:504] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.962679 23737 ts_tablet_manager.cc:1397] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.036s user 0.009s sys 0.012s
I20260807 13:38:28.961661 23794 raft_consensus.cc:504] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.974056 23684 raft_consensus.cc:2454] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:28.974617 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:28.976007 23532 leader_election.cc:341] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:28.975721 23429 leader_election.cc:302] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters: 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:28.976979 23774 raft_consensus.cc:2781] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:28.977689 23794 leader_election.cc:288] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:28.977777 23774 raft_consensus.cc:686] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:28.978466 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:28.978400 23737 raft_consensus.cc:348] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.984802 23737 raft_consensus.cc:374] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:28.984939 23684 raft_consensus.cc:2454] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:28.980901 23745 leader_election.cc:288] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:28.985790 23740 ts_tablet_manager.cc:1428] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.032s user 0.010s sys 0.000s
I20260807 13:38:28.986666 23740 tablet_bootstrap.cc:492] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:28.986869 23739 tablet_bootstrap.cc:654] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:28.981107 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:28.987341 23481 raft_consensus.cc:3037] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:28.988090 23533 leader_election.cc:302] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:28.989100 23745 raft_consensus.cc:2781] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:28.989537 23745 raft_consensus.cc:482] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:28.990057 23745 raft_consensus.cc:3037] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:28.994367 23740 tablet_bootstrap.cc:654] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:28.999116 23745 raft_consensus.cc:504] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.984161 23796 raft_consensus.cc:482] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:28.985140 23737 raft_consensus.cc:729] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:28.979054 23774 consensus_queue.cc:237] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.983220 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
W20260807 13:38:29.002951 23533 leader_election.cc:341] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:29.002275 23737 consensus_queue.cc:260] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.005885 23737 ts_tablet_manager.cc:1428] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.034s user 0.002s sys 0.006s
I20260807 13:38:29.010398 23737 tablet_bootstrap.cc:492] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:29.005396 23796 raft_consensus.cc:504] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:28.999511 23481 raft_consensus.cc:2454] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:29.019455 23532 leader_election.cc:302] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:29.016187 23740 tablet_bootstrap.cc:492] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:29.021567 23740 ts_tablet_manager.cc:1397] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.035s user 0.009s sys 0.010s
I20260807 13:38:29.022017 23797 raft_consensus.cc:2781] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:29.022166 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:29.022615 23797 raft_consensus.cc:686] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:29.023527 23797 consensus_queue.cc:237] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.024070 23745 leader_election.cc:288] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:29.024230 23740 raft_consensus.cc:348] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.025125 23740 raft_consensus.cc:374] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:29.025177 23796 leader_election.cc:288] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:29.025441 23740 raft_consensus.cc:729] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:29.026130 23740 consensus_queue.cc:260] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:29.027698 23532 leader_election.cc:341] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:29.028333 23740 ts_tablet_manager.cc:1428] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.006s user 0.004s sys 0.002s
I20260807 13:38:29.028642 23737 tablet_bootstrap.cc:654] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:29.029264 23740 tablet_bootstrap.cc:492] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:29.029615 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:29.030270 23684 raft_consensus.cc:2454] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:29.030431 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:29.029276 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:29.031562 23681 raft_consensus.cc:3037] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:38:29.031944 23532 leader_election.cc:341] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:29.035575 23740 tablet_bootstrap.cc:654] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:29.035434 23346 catalog_manager.cc:5495] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 0 to 1, leader changed from <none> to e11cad1eeaf5424c94e51241096f6613 (127.21.69.1). New cstate: current_term: 1 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:29.036748 23533 leader_election.cc:302] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:29.037999 23796 raft_consensus.cc:2781] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:29.038355 23796 raft_consensus.cc:482] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:29.038707 23796 raft_consensus.cc:3037] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.039191 23346 catalog_manager.cc:5495] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 0 to 1, leader changed from <none> to e11cad1eeaf5424c94e51241096f6613 (127.21.69.1). New cstate: current_term: 1 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:29.046736 23739 tablet_bootstrap.cc:492] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:29.046941 23796 raft_consensus.cc:504] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.049310 23796 leader_election.cc:288] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:29.050022 23681 raft_consensus.cc:2454] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:29.051154 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:29.051821 23684 raft_consensus.cc:3037] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.051154 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:29.055969 23739 ts_tablet_manager.cc:1397] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.090s user 0.017s sys 0.016s
I20260807 13:38:29.060321 23533 leader_election.cc:302] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:29.061314 23797 raft_consensus.cc:2781] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:29.062013 23797 raft_consensus.cc:686] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
W20260807 13:38:29.062286 23532 leader_election.cc:341] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:29.059947 23739 raft_consensus.cc:348] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.063020 23739 raft_consensus.cc:374] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:29.063318 23739 raft_consensus.cc:729] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:29.063226 23797 consensus_queue.cc:237] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.063657 23737 tablet_bootstrap.cc:492] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:29.064239 23739 consensus_queue.cc:260] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.064292 23684 raft_consensus.cc:2454] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:29.066679 23739 ts_tablet_manager.cc:1428] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20260807 13:38:29.066486 23533 leader_election.cc:302] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:29.065403 23737 ts_tablet_manager.cc:1397] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.055s user 0.018s sys 0.001s
I20260807 13:38:29.068959 23345 catalog_manager.cc:5495] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2). New cstate: current_term: 1 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:29.070760 23796 raft_consensus.cc:2781] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:29.071473 23796 raft_consensus.cc:686] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:29.072371 23796 consensus_queue.cc:237] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.069800 23737 raft_consensus.cc:348] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.074280 23737 raft_consensus.cc:374] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:29.074587 23737 raft_consensus.cc:729] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:29.069829 23739 tablet_bootstrap.cc:492] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:29.079823 23737 consensus_queue.cc:260] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.082659 23737 ts_tablet_manager.cc:1428] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20260807 13:38:29.083132 23739 tablet_bootstrap.cc:654] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:29.086531 23794 raft_consensus.cc:482] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:29.087230 23794 raft_consensus.cc:504] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.091523 23794 leader_election.cc:288] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:29.091581 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:29.093098 23481 raft_consensus.cc:2454] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:29.095219 23532 leader_election.cc:302] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:29.096434 23794 raft_consensus.cc:2781] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:29.096805 23794 raft_consensus.cc:482] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:29.099133 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:29.097155 23794 raft_consensus.cc:3037] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.100152 23684 raft_consensus.cc:2454] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:29.103691 23737 tablet_bootstrap.cc:492] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:29.105993 23739 tablet_bootstrap.cc:492] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:29.106501 23739 ts_tablet_manager.cc:1397] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.037s user 0.010s sys 0.005s
I20260807 13:38:29.109042 23739 raft_consensus.cc:348] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.109244 23794 raft_consensus.cc:504] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.109889 23739 raft_consensus.cc:374] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:29.110347 23737 tablet_bootstrap.cc:654] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:29.110258 23739 raft_consensus.cc:729] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:29.111204 23739 consensus_queue.cc:260] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.112373 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:29.112982 23481 raft_consensus.cc:3037] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.113083 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:29.113667 23684 raft_consensus.cc:3037] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.119540 23774 raft_consensus.cc:482] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:29.120297 23774 raft_consensus.cc:504] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.121680 23684 raft_consensus.cc:2454] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:29.123088 23533 leader_election.cc:302] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:29.123950 23797 raft_consensus.cc:2781] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:29.124446 23797 raft_consensus.cc:686] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:29.124442 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:29.124589 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:29.125288 23681 raft_consensus.cc:2454] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:38:29.125516 23797 consensus_queue.cc:237] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:29.126175 23430 leader_election.cc:341] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:29.126655 23774 leader_election.cc:288] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:29.126782 23429 leader_election.cc:302] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters: 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:29.128043 23774 raft_consensus.cc:2781] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:29.128412 23739 ts_tablet_manager.cc:1428] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.022s user 0.007s sys 0.001s
I20260807 13:38:29.128419 23774 raft_consensus.cc:482] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:29.129017 23774 raft_consensus.cc:3037] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.129699 23739 tablet_bootstrap.cc:492] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:29.133015 23481 raft_consensus.cc:2454] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:29.119150 23343 catalog_manager.cc:5495] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2). New cstate: current_term: 1 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:29.138010 23739 tablet_bootstrap.cc:654] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:29.126186 23794 leader_election.cc:288] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:29.137235 23343 catalog_manager.cc:5495] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2). New cstate: current_term: 1 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:29.138262 23740 tablet_bootstrap.cc:492] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:29.139441 23740 ts_tablet_manager.cc:1397] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.110s user 0.028s sys 0.029s
I20260807 13:38:29.142323 23747 raft_consensus.cc:482] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:29.142405 23740 raft_consensus.cc:348] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.143103 23747 raft_consensus.cc:504] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.146996 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:29.143275 23740 raft_consensus.cc:374] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:29.147847 23740 raft_consensus.cc:729] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:29.147907 23481 raft_consensus.cc:2454] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 0.
I20260807 13:38:29.148749 23740 consensus_queue.cc:260] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.149416 23631 leader_election.cc:302] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:29.151170 23740 ts_tablet_manager.cc:1428] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.011s user 0.004s sys 0.001s
I20260807 13:38:29.152305 23740 tablet_bootstrap.cc:492] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:29.153208 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:29.154244 23581 raft_consensus.cc:2454] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 0.
I20260807 13:38:29.160568 23811 raft_consensus.cc:2781] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:29.161402 23811 raft_consensus.cc:482] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:29.161876 23811 raft_consensus.cc:3037] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.161800 23774 raft_consensus.cc:504] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.165091 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:29.165735 23581 raft_consensus.cc:3037] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.166987 23747 leader_election.cc:288] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:29.171258 23737 tablet_bootstrap.cc:492] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:29.171797 23737 ts_tablet_manager.cc:1397] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.068s user 0.018s sys 0.009s
I20260807 13:38:29.172155 23774 leader_election.cc:288] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:29.173363 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:29.174034 23684 raft_consensus.cc:3037] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.173961 23581 raft_consensus.cc:2454] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:29.174319 23737 raft_consensus.cc:348] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.175841 23737 raft_consensus.cc:374] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:29.176101 23737 raft_consensus.cc:729] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:29.176838 23737 consensus_queue.cc:260] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.179132 23737 ts_tablet_manager.cc:1428] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 13:38:29.180912 23739 tablet_bootstrap.cc:492] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:29.181339 23739 ts_tablet_manager.cc:1397] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.052s user 0.011s sys 0.024s
I20260807 13:38:29.183061 23739 raft_consensus.cc:348] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:38:29.183367 23430 leader_election.cc:302] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:29.183591 23739 raft_consensus.cc:374] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:29.183955 23739 raft_consensus.cc:729] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:29.184381 23774 raft_consensus.cc:2781] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:29.184425 23684 raft_consensus.cc:2454] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:29.185014 23774 raft_consensus.cc:686] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:29.184696 23739 consensus_queue.cc:260] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:38:29.185832 23774 consensus_queue.cc:237] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.187028 23737 tablet_bootstrap.cc:492] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:29.181704 23343 catalog_manager.cc:5495] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2). New cstate: current_term: 1 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:29.185808 23811 raft_consensus.cc:504] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.192176 23740 tablet_bootstrap.cc:654] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:29.192827 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:29.193275 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:29.193463 23581 raft_consensus.cc:3037] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.193924 23481 raft_consensus.cc:3037] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.197155 23811 leader_election.cc:288] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:29.200273 23739 ts_tablet_manager.cc:1428] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.019s user 0.006s sys 0.001s
I20260807 13:38:29.201325 23739 tablet_bootstrap.cc:492] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:29.210353 23774 raft_consensus.cc:482] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:29.212308 23737 tablet_bootstrap.cc:654] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:29.212970 23481 raft_consensus.cc:2454] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:29.213351 23739 tablet_bootstrap.cc:654] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:29.211030 23346 catalog_manager.cc:5495] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 0 to 1, leader changed from <none> to e11cad1eeaf5424c94e51241096f6613 (127.21.69.1). New cstate: current_term: 1 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:29.210987 23774 raft_consensus.cc:504] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.215065 23631 leader_election.cc:302] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:29.215348 23581 raft_consensus.cc:2454] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:29.215984 23811 raft_consensus.cc:2781] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:29.216985 23774 leader_election.cc:288] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:29.217355 23811 raft_consensus.cc:686] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:29.219208 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:29.220074 23684 raft_consensus.cc:2379] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 1: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:29.219859 23811 consensus_queue.cc:237] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.223870 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:29.226183 23430 leader_election.cc:302] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:29.227478 23774 raft_consensus.cc:3037] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.227744 23740 tablet_bootstrap.cc:492] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:29.230548 23740 ts_tablet_manager.cc:1397] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.079s user 0.013s sys 0.008s
I20260807 13:38:29.233451 23740 raft_consensus.cc:348] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.233857 23737 tablet_bootstrap.cc:492] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:29.234184 23740 raft_consensus.cc:374] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:29.234472 23737 ts_tablet_manager.cc:1397] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.048s user 0.011s sys 0.010s
I20260807 13:38:29.236071 23774 raft_consensus.cc:2726] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:29.235790 23343 catalog_manager.cc:5495] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3). New cstate: current_term: 1 leader_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: HEALTHY } } }
I20260807 13:38:29.234503 23740 raft_consensus.cc:729] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:29.237218 23737 raft_consensus.cc:348] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.237936 23737 raft_consensus.cc:374] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:29.238229 23737 raft_consensus.cc:729] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:29.237818 23740 consensus_queue.cc:260] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.239149 23737 consensus_queue.cc:260] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.240243 23740 ts_tablet_manager.cc:1428] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.009s user 0.006s sys 0.001s
I20260807 13:38:29.241164 23797 raft_consensus.cc:482] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:29.241436 23737 ts_tablet_manager.cc:1428] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 13:38:29.241653 23797 raft_consensus.cc:504] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.242511 23737 tablet_bootstrap.cc:492] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:29.243731 23797 leader_election.cc:288] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:29.244532 23407 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:38:29.246222 23740 tablet_bootstrap.cc:492] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:29.247016 23739 tablet_bootstrap.cc:492] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:29.247433 23739 ts_tablet_manager.cc:1397] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.046s user 0.015s sys 0.003s
I20260807 13:38:29.247972 23811 raft_consensus.cc:482] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:29.248517 23811 raft_consensus.cc:504] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:38:29.249006 23737 tablet_bootstrap.cc:654] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:29.250979 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:29.250921 23739 raft_consensus.cc:348] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.251397 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:29.251744 23739 raft_consensus.cc:374] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:29.252044 23739 raft_consensus.cc:729] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
W20260807 13:38:29.252700 23533 leader_election.cc:341] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:29.252775 23739 consensus_queue.cc:260] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.253768 23481 raft_consensus.cc:2454] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:29.253995 23811 leader_election.cc:288] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037)
I20260807 13:38:29.252816 23740 tablet_bootstrap.cc:654] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:29.256011 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:29.256675 23581 raft_consensus.cc:2454] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 0.
I20260807 13:38:29.256748 23532 leader_election.cc:302] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:29.258956 23633 leader_election.cc:302] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:29.259965 23797 raft_consensus.cc:2781] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:29.261642 23797 raft_consensus.cc:482] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:29.262122 23797 raft_consensus.cc:3037] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.260460 23811 raft_consensus.cc:2781] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:29.263857 23811 raft_consensus.cc:482] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:29.264293 23811 raft_consensus.cc:3037] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.261111 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:29.267016 23481 raft_consensus.cc:2454] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 0.
I20260807 13:38:29.269079 23774 consensus_queue.cc:1035] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:29.272380 23739 ts_tablet_manager.cc:1428] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.025s user 0.007s sys 0.000s
I20260807 13:38:29.274497 23811 raft_consensus.cc:504] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:38:29.284351 23797 raft_consensus.cc:504] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.298242 23739 tablet_bootstrap.cc:492] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:29.301414 23811 leader_election.cc:288] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037)
I20260807 13:38:29.360518 23739 tablet_bootstrap.cc:654] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:29.326538 23794 raft_consensus.cc:482] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:29.365275 23737 tablet_bootstrap.cc:492] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:29.301614 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:29.302223 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:29.311781 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:29.365384 23794 raft_consensus.cc:504] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.367442 23737 ts_tablet_manager.cc:1397] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.125s user 0.019s sys 0.041s
I20260807 13:38:29.362968 23740 tablet_bootstrap.cc:492] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:29.372121 23740 ts_tablet_manager.cc:1397] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.126s user 0.021s sys 0.039s
I20260807 13:38:29.371964 23737 raft_consensus.cc:348] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.372905 23737 raft_consensus.cc:374] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:29.303993 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:29.373270 23737 raft_consensus.cc:729] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:29.374089 23737 consensus_queue.cc:260] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.374814 23740 raft_consensus.cc:348] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.311936 23681 raft_consensus.cc:3037] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.375795 23777 raft_consensus.cc:482] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:29.376227 23737 ts_tablet_manager.cc:1428] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 13:38:29.376271 23777 raft_consensus.cc:504] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.377211 23737 tablet_bootstrap.cc:492] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:29.378561 23777 leader_election.cc:288] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:29.368544 23581 raft_consensus.cc:3037] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.368984 23481 raft_consensus.cc:3037] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.302341 23797 leader_election.cc:288] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:29.380090 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:29.380551 23684 raft_consensus.cc:3037] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.382614 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:29.383368 23737 tablet_bootstrap.cc:654] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:29.387048 23481 raft_consensus.cc:2454] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:29.387292 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:29.383481 23680 raft_consensus.cc:2379] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 1: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:29.390496 23794 leader_election.cc:288] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:29.391623 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:29.401612 23532 leader_election.cc:302] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:29.401959 23679 raft_consensus.cc:2379] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 1: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:29.367975 23480 raft_consensus.cc:3037] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.389503 23684 raft_consensus.cc:2454] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:29.402523 23794 raft_consensus.cc:2781] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:29.403096 23794 raft_consensus.cc:686] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:29.395090 23777 consensus_queue.cc:1035] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:38:29.403759 23533 leader_election.cc:302] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:29.404824 23797 raft_consensus.cc:3037] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.395987 23737 tablet_bootstrap.cc:492] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:29.405793 23737 ts_tablet_manager.cc:1397] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.029s user 0.016s sys 0.000s
I20260807 13:38:29.406569 23794 consensus_queue.cc:237] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.396683 23747 raft_consensus.cc:482] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:29.408053 23747 raft_consensus.cc:504] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.375545 23740 raft_consensus.cc:374] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:29.409296 23740 raft_consensus.cc:729] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:29.410041 23740 consensus_queue.cc:260] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.410744 23480 raft_consensus.cc:2454] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:29.411660 23430 leader_election.cc:302] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:29.412020 23631 leader_election.cc:302] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:29.412652 23777 raft_consensus.cc:3037] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.412971 23740 ts_tablet_manager.cc:1428] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.040s user 0.006s sys 0.001s
I20260807 13:38:29.413945 23740 tablet_bootstrap.cc:492] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:29.414835 23811 raft_consensus.cc:2781] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:29.417470 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:29.410581 23737 raft_consensus.cc:348] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.397725 23746 consensus_queue.cc:1035] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:38:29.422348 23737 raft_consensus.cc:374] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:29.422742 23737 raft_consensus.cc:729] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:29.423535 23737 consensus_queue.cc:260] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.428100 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:29.419462 23747 leader_election.cc:288] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:29.430039 23631 leader_election.cc:302] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:29.397298 23739 tablet_bootstrap.cc:492] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:29.431154 23797 raft_consensus.cc:2726] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:29.400380 23581 raft_consensus.cc:2454] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:29.431427 23739 ts_tablet_manager.cc:1397] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.133s user 0.017s sys 0.004s
I20260807 13:38:29.419878 23740 tablet_bootstrap.cc:654] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:29.428562 23777 raft_consensus.cc:2726] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:29.435302 23739 raft_consensus.cc:348] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.437433 23739 raft_consensus.cc:374] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:29.437777 23739 raft_consensus.cc:729] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:29.436730 23777 consensus_queue.cc:1035] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:38:29.447304 23737 ts_tablet_manager.cc:1428] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.041s user 0.013s sys 0.009s
I20260807 13:38:29.448312 23737 tablet_bootstrap.cc:492] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:29.448921 23680 raft_consensus.cc:3037] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.449692 23811 raft_consensus.cc:686] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:29.450603 23811 consensus_queue.cc:237] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:38:29.452433 23740 tablet_bootstrap.cc:492] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:29.452920 23740 ts_tablet_manager.cc:1397] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.039s user 0.007s sys 0.004s
I20260807 13:38:29.454372 23794 raft_consensus.cc:482] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:29.454708 23737 tablet_bootstrap.cc:654] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:29.456979 23739 consensus_queue.cc:260] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.459611 23740 raft_consensus.cc:348] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.460579 23740 raft_consensus.cc:374] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:29.460943 23740 raft_consensus.cc:729] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:29.462102 23740 consensus_queue.cc:260] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.465646 23739 ts_tablet_manager.cc:1428] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.033s user 0.006s sys 0.001s
I20260807 13:38:29.455291 23794 raft_consensus.cc:504] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.480394 23346 catalog_manager.cc:5495] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2). New cstate: current_term: 1 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:29.485639 23740 ts_tablet_manager.cc:1428] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.032s user 0.007s sys 0.002s
I20260807 13:38:29.489487 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:29.495170 23740 tablet_bootstrap.cc:492] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:29.494592 23480 raft_consensus.cc:2454] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:29.498355 23532 leader_election.cc:302] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:29.499501 23797 raft_consensus.cc:2781] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:29.499930 23797 raft_consensus.cc:482] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:29.500283 23797 raft_consensus.cc:3037] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.500571 23746 consensus_queue.cc:1035] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:38:29.502241 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:29.503974 23533 leader_election.cc:341] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:29.504680 23794 leader_election.cc:288] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:29.512933 23797 raft_consensus.cc:504] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.513604 23747 raft_consensus.cc:2726] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:29.516346 23740 tablet_bootstrap.cc:654] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:29.518406 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:29.519308 23480 raft_consensus.cc:3037] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.522544 23739 tablet_bootstrap.cc:492] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:29.530272 23747 raft_consensus.cc:482] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:29.533052 23747 raft_consensus.cc:504] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.535956 23740 tablet_bootstrap.cc:492] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:29.535406 23747 leader_election.cc:288] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:29.536576 23740 ts_tablet_manager.cc:1397] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.042s user 0.012s sys 0.007s
I20260807 13:38:29.540875 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:29.542421 23633 leader_election.cc:341] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:29.543416 23794 consensus_queue.cc:1035] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:29.548642 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:29.550074 23777 consensus_queue.cc:1035] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260807 13:38:29.550506 23533 leader_election.cc:341] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:29.553647 23794 consensus_queue.cc:1035] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:29.546367 23797 leader_election.cc:288] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:29.541316 23345 catalog_manager.cc:5495] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3). New cstate: current_term: 1 leader_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:29.562491 23796 consensus_queue.cc:1035] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:29.553853 23480 raft_consensus.cc:2454] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:29.566607 23737 tablet_bootstrap.cc:492] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:29.567436 23737 ts_tablet_manager.cc:1397] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.119s user 0.016s sys 0.007s
I20260807 13:38:29.570864 23794 consensus_queue.cc:1035] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:38:29.571110 23532 leader_election.cc:302] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:29.572111 23796 raft_consensus.cc:2781] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:29.573346 23794 consensus_queue.cc:1035] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260807 13:38:29.613904 23739 tablet_bootstrap.cc:654] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
W20260807 13:38:29.616163 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 86319.9us
I20260807 13:38:29.645608 23681 raft_consensus.cc:3037] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.678006 23740 raft_consensus.cc:348] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.679759 23740 raft_consensus.cc:374] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:29.680042 23740 raft_consensus.cc:729] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:29.680645 23740 consensus_queue.cc:260] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.687436 23740 ts_tablet_manager.cc:1428] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.150s user 0.009s sys 0.000s
I20260807 13:38:29.689232 23740 tablet_bootstrap.cc:492] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:29.689436 23737 raft_consensus.cc:348] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.690861 23737 raft_consensus.cc:374] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:29.691143 23737 raft_consensus.cc:729] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:29.689999 23774 consensus_queue.cc:1035] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260807 13:38:29.691730 23794 consensus_queue.cc:1035] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:38:29.691883 23737 consensus_queue.cc:260] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.694118 23737 ts_tablet_manager.cc:1428] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.126s user 0.010s sys 0.001s
I20260807 13:38:29.695047 23737 tablet_bootstrap.cc:492] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:29.683878 23796 raft_consensus.cc:686] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:29.705766 23797 consensus_queue.cc:1035] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260807 13:38:29.724224 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:29.719172 23774 consensus_queue.cc:1035] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260807 13:38:29.727607 23796 consensus_queue.cc:237] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:29.730512 23631 leader_election.cc:341] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:29.731069 23631 leader_election.cc:302] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:29.732379 23811 raft_consensus.cc:2726] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:29.794111 23737 tablet_bootstrap.cc:654] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:29.795135 23747 raft_consensus.cc:482] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:29.796303 23747 raft_consensus.cc:504] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.804690 23747 leader_election.cc:288] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:29.808451 23859 raft_consensus.cc:482] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:29.813036 23739 tablet_bootstrap.cc:492] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:29.813438 23739 ts_tablet_manager.cc:1397] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.291s user 0.025s sys 0.026s
I20260807 13:38:29.810240 23862 consensus_queue.cc:1035] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260807 13:38:29.815497 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:29.810097 23859 raft_consensus.cc:504] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.825034 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:29.829337 23740 tablet_bootstrap.cc:654] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:29.838413 23631 leader_election.cc:302] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:29.839805 23811 raft_consensus.cc:2726] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:29.843035 23859 leader_election.cc:288] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:29.820288 23747 consensus_queue.cc:1035] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260807 13:38:29.858574 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:29.865216 23533 leader_election.cc:341] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:29.870206 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:29.878290 23739 raft_consensus.cc:348] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.888355 23739 raft_consensus.cc:374] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:29.890149 23739 raft_consensus.cc:729] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:29.882813 23835 consensus_queue.cc:1035] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260807 13:38:29.897143 23739 consensus_queue.cc:260] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.901974 23739 ts_tablet_manager.cc:1428] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.088s user 0.004s sys 0.005s
I20260807 13:38:29.916349 23481 raft_consensus.cc:2454] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:29.919549 23747 raft_consensus.cc:482] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:29.920162 23747 raft_consensus.cc:504] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.922299 23747 leader_election.cc:288] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:29.924998 23532 leader_election.cc:302] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:29.925921 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:29.927006 23794 raft_consensus.cc:2781] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:29.927561 23794 raft_consensus.cc:482] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:29.928040 23794 raft_consensus.cc:3037] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:38:29.929369 23633 leader_election.cc:341] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:29.935681 23862 consensus_queue.cc:1035] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:29.941815 23739 tablet_bootstrap.cc:492] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:29.943066 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:29.945680 23631 leader_election.cc:341] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:29.946381 23631 leader_election.cc:302] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:29.947320 23835 raft_consensus.cc:2726] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:29.943825 23862 consensus_queue.cc:1035] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:38:29.956898 23737 tablet_bootstrap.cc:492] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:29.957551 23737 ts_tablet_manager.cc:1397] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.263s user 0.010s sys 0.025s
I20260807 13:38:29.973838 23794 raft_consensus.cc:504] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:29.980782 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:29.980865 23811 consensus_queue.cc:1035] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:29.983238 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:30.005856 23479 raft_consensus.cc:3037] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:29.977247 23794 leader_election.cc:288] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:29.985893 23737 raft_consensus.cc:348] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.068708 23737 raft_consensus.cc:374] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:30.068972 23737 raft_consensus.cc:729] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:30.060743 23739 tablet_bootstrap.cc:654] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:30.069525 23737 consensus_queue.cc:260] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:29.983543 23533 leader_election.cc:341] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:38:30.071856 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 88384us
I20260807 13:38:30.076565 23740 tablet_bootstrap.cc:492] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:30.077042 23740 ts_tablet_manager.cc:1397] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.388s user 0.021s sys 0.012s
I20260807 13:38:30.081764 23737 ts_tablet_manager.cc:1428] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.124s user 0.000s sys 0.017s
I20260807 13:38:30.082659 23737 tablet_bootstrap.cc:492] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:30.080379 23794 raft_consensus.cc:482] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:30.085489 23794 raft_consensus.cc:504] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.087558 23794 leader_election.cc:288] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:30.088919 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:30.089869 23901 consensus_queue.cc:1035] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
W20260807 13:38:30.090649 23532 leader_election.cc:341] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:30.065191 23345 catalog_manager.cc:5495] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2). New cstate: current_term: 1 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:30.107456 23739 tablet_bootstrap.cc:492] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:30.108173 23739 ts_tablet_manager.cc:1397] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.167s user 0.020s sys 0.010s
I20260807 13:38:30.104707 23740 raft_consensus.cc:348] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.110651 23740 raft_consensus.cc:374] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:30.111313 23740 raft_consensus.cc:729] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:30.115248 23740 consensus_queue.cc:260] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.118417 23740 ts_tablet_manager.cc:1428] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.041s user 0.008s sys 0.001s
I20260807 13:38:30.119361 23740 tablet_bootstrap.cc:492] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:30.119483 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:30.120216 23679 raft_consensus.cc:2454] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:30.114377 23739 raft_consensus.cc:348] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.121420 23533 leader_election.cc:302] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:30.121923 23739 raft_consensus.cc:374] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:30.122428 23739 raft_consensus.cc:729] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:30.102252 23479 raft_consensus.cc:2454] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:30.123600 23876 raft_consensus.cc:2781] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:30.124343 23876 raft_consensus.cc:482] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:30.125087 23876 raft_consensus.cc:3037] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:30.126341 23739 consensus_queue.cc:260] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.129709 23739 ts_tablet_manager.cc:1428] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20260807 13:38:30.131315 23739 tablet_bootstrap.cc:492] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:30.135448 23876 raft_consensus.cc:504] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.138660 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
W20260807 13:38:30.140843 23532 leader_election.cc:341] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:30.141315 23876 leader_election.cc:288] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:30.141888 23532 leader_election.cc:302] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:30.142876 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:30.143808 23876 raft_consensus.cc:2781] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:30.144240 23679 raft_consensus.cc:3037] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:30.147109 23740 tablet_bootstrap.cc:654] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:30.151312 23739 tablet_bootstrap.cc:654] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:30.153097 23876 raft_consensus.cc:686] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:30.154246 23876 consensus_queue.cc:237] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.154832 23737 tablet_bootstrap.cc:654] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:30.162948 23739 tablet_bootstrap.cc:492] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:30.166626 23679 raft_consensus.cc:2454] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:30.163635 23739 ts_tablet_manager.cc:1397] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.033s user 0.006s sys 0.005s
I20260807 13:38:30.169699 23533 leader_election.cc:302] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:30.170147 23740 tablet_bootstrap.cc:492] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:30.170559 23740 ts_tablet_manager.cc:1397] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.051s user 0.016s sys 0.012s
I20260807 13:38:30.170912 23794 raft_consensus.cc:2781] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:30.171433 23794 raft_consensus.cc:686] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:30.172533 23739 raft_consensus.cc:348] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.172628 23794 consensus_queue.cc:237] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.173059 23740 raft_consensus.cc:348] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.173723 23740 raft_consensus.cc:374] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:30.174046 23740 raft_consensus.cc:729] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:30.174787 23740 consensus_queue.cc:260] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.177114 23740 ts_tablet_manager.cc:1428] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 13:38:30.177990 23740 tablet_bootstrap.cc:492] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:30.178027 23737 tablet_bootstrap.cc:492] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:30.178745 23737 ts_tablet_manager.cc:1397] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.096s user 0.011s sys 0.005s
I20260807 13:38:30.181416 23737 raft_consensus.cc:348] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.182346 23737 raft_consensus.cc:374] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:30.182695 23737 raft_consensus.cc:729] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:30.183416 23737 consensus_queue.cc:260] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.185492 23740 tablet_bootstrap.cc:654] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:30.185739 23737 ts_tablet_manager.cc:1428] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260807 13:38:30.186725 23737 tablet_bootstrap.cc:492] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:30.190515 23739 raft_consensus.cc:374] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:30.194100 23737 tablet_bootstrap.cc:654] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:30.197968 23739 raft_consensus.cc:729] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:30.198709 23739 consensus_queue.cc:260] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.205209 23739 ts_tablet_manager.cc:1428] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.036s user 0.006s sys 0.001s
I20260807 13:38:30.210850 23739 tablet_bootstrap.cc:492] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:30.215050 23737 tablet_bootstrap.cc:492] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:30.215579 23737 ts_tablet_manager.cc:1397] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.029s user 0.017s sys 0.000s
I20260807 13:38:30.218870 23737 raft_consensus.cc:348] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.219576 23737 raft_consensus.cc:374] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:30.219872 23737 raft_consensus.cc:729] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:30.220448 23740 tablet_bootstrap.cc:492] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:30.220878 23739 tablet_bootstrap.cc:654] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:30.220945 23740 ts_tablet_manager.cc:1397] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.043s user 0.007s sys 0.010s
I20260807 13:38:30.220624 23737 consensus_queue.cc:260] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.223933 23740 raft_consensus.cc:348] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.224709 23740 raft_consensus.cc:374] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:30.225010 23740 raft_consensus.cc:729] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:30.225680 23740 consensus_queue.cc:260] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.227802 23740 ts_tablet_manager.cc:1428] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 13:38:30.227980 23737 ts_tablet_manager.cc:1428] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.012s user 0.007s sys 0.000s
I20260807 13:38:30.228752 23740 tablet_bootstrap.cc:492] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:30.228802 23737 tablet_bootstrap.cc:492] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:30.232198 23345 catalog_manager.cc:5495] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2). New cstate: current_term: 1 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:30.235536 23345 catalog_manager.cc:5495] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2). New cstate: current_term: 1 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:30.236893 23737 tablet_bootstrap.cc:654] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:30.248756 23740 tablet_bootstrap.cc:654] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:30.254431 23737 tablet_bootstrap.cc:492] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:30.254905 23737 ts_tablet_manager.cc:1397] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.026s user 0.016s sys 0.000s
I20260807 13:38:30.254962 23739 tablet_bootstrap.cc:492] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:30.255414 23739 ts_tablet_manager.cc:1397] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.045s user 0.011s sys 0.007s
I20260807 13:38:30.257813 23737 raft_consensus.cc:348] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.258751 23737 raft_consensus.cc:374] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:30.258561 23876 consensus_queue.cc:1035] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:30.259135 23737 raft_consensus.cc:729] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:30.260901 23739 raft_consensus.cc:348] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.261900 23739 raft_consensus.cc:374] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:30.262225 23739 raft_consensus.cc:729] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:30.263003 23739 consensus_queue.cc:260] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.266499 23737 consensus_queue.cc:260] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.271328 23737 ts_tablet_manager.cc:1428] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.016s user 0.006s sys 0.003s
I20260807 13:38:30.273579 23737 tablet_bootstrap.cc:492] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
W20260807 13:38:30.277206 23407 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:38:30.281169 23739 ts_tablet_manager.cc:1428] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.025s user 0.006s sys 0.000s
I20260807 13:38:30.282327 23739 tablet_bootstrap.cc:492] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:30.282909 23901 raft_consensus.cc:482] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:30.283473 23901 raft_consensus.cc:504] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.285861 23901 leader_election.cc:288] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:30.287832 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:30.289484 23633 leader_election.cc:341] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:30.285998 23737 tablet_bootstrap.cc:654] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:30.295907 23679 raft_consensus.cc:3037] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:30.296113 23740 tablet_bootstrap.cc:492] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:30.296696 23740 ts_tablet_manager.cc:1397] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.068s user 0.016s sys 0.016s
I20260807 13:38:30.299331 23740 raft_consensus.cc:348] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.299863 23739 tablet_bootstrap.cc:654] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:30.300159 23740 raft_consensus.cc:374] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:30.300505 23740 raft_consensus.cc:729] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:30.301844 23740 consensus_queue.cc:260] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.304311 23740 ts_tablet_manager.cc:1428] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260807 13:38:30.307557 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:30.309437 23631 leader_election.cc:341] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:30.309928 23631 leader_election.cc:302] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:30.311836 23899 raft_consensus.cc:2726] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:30.312978 23737 tablet_bootstrap.cc:492] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:30.313681 23737 ts_tablet_manager.cc:1397] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.040s user 0.012s sys 0.001s
I20260807 13:38:30.316337 23901 raft_consensus.cc:482] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:30.316901 23901 raft_consensus.cc:504] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.317699 23796 consensus_queue.cc:1035] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:38:30.318382 23740 tablet_bootstrap.cc:492] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:30.322760 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:30.325555 23901 leader_election.cc:288] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:30.325886 23740 tablet_bootstrap.cc:654] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:30.330094 23796 raft_consensus.cc:482] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:30.330374 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:30.330646 23796 raft_consensus.cc:504] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.326627 23737 raft_consensus.cc:348] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.332290 23737 raft_consensus.cc:374] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:30.332618 23737 raft_consensus.cc:729] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:30.332584 23633 leader_election.cc:302] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:30.333441 23796 leader_election.cc:288] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:30.333596 23737 consensus_queue.cc:260] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.335717 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:30.337352 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:30.338104 23681 raft_consensus.cc:2454] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
W20260807 13:38:30.339408 23532 leader_election.cc:341] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:30.345862 23740 tablet_bootstrap.cc:492] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:30.345472 23533 leader_election.cc:302] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:30.346372 23740 ts_tablet_manager.cc:1397] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.041s user 0.020s sys 0.003s
I20260807 13:38:30.346728 23796 raft_consensus.cc:2781] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:30.347124 23796 raft_consensus.cc:482] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:30.345470 23737 ts_tablet_manager.cc:1428] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.031s user 0.006s sys 0.000s
I20260807 13:38:30.347612 23796 raft_consensus.cc:3037] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:30.348706 23737 tablet_bootstrap.cc:492] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:30.349409 23740 raft_consensus.cc:348] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.350207 23740 raft_consensus.cc:374] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:30.350479 23740 raft_consensus.cc:729] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:30.351306 23740 consensus_queue.cc:260] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.354490 23740 ts_tablet_manager.cc:1428] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260807 13:38:30.354503 23901 raft_consensus.cc:2726] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:30.355682 23740 tablet_bootstrap.cc:492] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:30.359714 23737 tablet_bootstrap.cc:654] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:30.362089 23740 tablet_bootstrap.cc:654] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:30.366196 23794 raft_consensus.cc:482] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:30.366919 23794 raft_consensus.cc:504] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.369899 23794 leader_election.cc:288] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:30.371168 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:30.372206 23479 raft_consensus.cc:2454] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:30.374670 23532 leader_election.cc:302] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:30.371188 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:30.376935 23681 raft_consensus.cc:2454] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:30.384763 23794 raft_consensus.cc:2781] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:30.386272 23794 raft_consensus.cc:482] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:30.386384 23797 raft_consensus.cc:482] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:30.387010 23797 raft_consensus.cc:504] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.388971 23739 tablet_bootstrap.cc:492] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:30.390039 23797 leader_election.cc:288] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:30.391108 23794 raft_consensus.cc:3037] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:30.397609 23737 tablet_bootstrap.cc:492] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:30.398064 23737 ts_tablet_manager.cc:1397] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.050s user 0.016s sys 0.017s
I20260807 13:38:30.391422 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:30.400748 23737 raft_consensus.cc:348] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.401026 23681 raft_consensus.cc:2454] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:30.401544 23737 raft_consensus.cc:374] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:30.401881 23737 raft_consensus.cc:729] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:30.389676 23739 ts_tablet_manager.cc:1397] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.108s user 0.009s sys 0.008s
I20260807 13:38:30.402858 23533 leader_election.cc:302] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:30.403905 23797 raft_consensus.cc:2781] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:30.402577 23737 consensus_queue.cc:260] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.405197 23796 raft_consensus.cc:504] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.404304 23797 raft_consensus.cc:482] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:30.406602 23797 raft_consensus.cc:3037] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:30.414722 23739 raft_consensus.cc:348] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.415578 23739 raft_consensus.cc:374] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:30.415910 23739 raft_consensus.cc:729] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:30.416563 23739 consensus_queue.cc:260] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.416950 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:30.417161 23737 ts_tablet_manager.cc:1428] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.019s user 0.007s sys 0.001s
I20260807 13:38:30.418210 23737 tablet_bootstrap.cc:492] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:30.419221 23739 ts_tablet_manager.cc:1428] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.016s user 0.005s sys 0.001s
W20260807 13:38:30.419734 23532 leader_election.cc:341] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:30.421099 23739 tablet_bootstrap.cc:492] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:30.422175 23796 leader_election.cc:288] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:30.396459 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:30.422921 23479 raft_consensus.cc:2454] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:30.427402 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:30.428169 23680 raft_consensus.cc:3037] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:30.430177 23794 raft_consensus.cc:504] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.438503 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:30.439200 23479 raft_consensus.cc:3037] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:30.440181 23739 tablet_bootstrap.cc:654] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:30.441090 23796 raft_consensus.cc:482] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:30.441773 23796 raft_consensus.cc:504] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.445132 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:30.445530 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:30.446179 23681 raft_consensus.cc:2454] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:30.446401 23737 tablet_bootstrap.cc:654] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
W20260807 13:38:30.446789 23532 leader_election.cc:341] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:30.453697 23680 raft_consensus.cc:2454] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:30.455138 23740 tablet_bootstrap.cc:492] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:30.443986 23796 leader_election.cc:288] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:30.455823 23740 ts_tablet_manager.cc:1397] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.100s user 0.033s sys 0.023s
I20260807 13:38:30.448165 23794 leader_election.cc:288] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:30.450927 23479 raft_consensus.cc:2454] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:30.452008 23797 raft_consensus.cc:504] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.458420 23797 leader_election.cc:288] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:30.458571 23740 raft_consensus.cc:348] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.459319 23740 raft_consensus.cc:374] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:30.455094 23533 leader_election.cc:302] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:30.459627 23740 raft_consensus.cc:729] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:30.460481 23862 raft_consensus.cc:2781] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:30.463625 23740 consensus_queue.cc:260] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.464278 23746 raft_consensus.cc:482] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:30.465395 23740 ts_tablet_manager.cc:1428] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.009s user 0.003s sys 0.002s
I20260807 13:38:30.464982 23746 raft_consensus.cc:504] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.462024 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:30.466187 23680 raft_consensus.cc:3037] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:30.466328 23740 tablet_bootstrap.cc:492] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:30.467185 23737 tablet_bootstrap.cc:492] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:30.465145 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:30.467677 23737 ts_tablet_manager.cc:1397] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.050s user 0.007s sys 0.009s
I20260807 13:38:30.467909 23681 raft_consensus.cc:3037] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:30.464385 23862 raft_consensus.cc:482] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:30.470942 23737 raft_consensus.cc:348] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.471391 23862 raft_consensus.cc:3037] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:30.473213 23740 tablet_bootstrap.cc:654] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:30.474086 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:30.462769 23533 leader_election.cc:302] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
W20260807 13:38:30.475945 23429 leader_election.cc:341] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:30.477174 23794 raft_consensus.cc:2781] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:30.477882 23794 raft_consensus.cc:686] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:30.479169 23794 consensus_queue.cc:237] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.479745 23862 raft_consensus.cc:504] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.481835 23862 leader_election.cc:288] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:30.482349 23746 leader_election.cc:288] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:30.482537 23737 raft_consensus.cc:374] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:30.481766 23532 leader_election.cc:302] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:30.486284 23737 raft_consensus.cc:729] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:30.461697 23739 tablet_bootstrap.cc:492] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:30.489395 23737 consensus_queue.cc:260] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.490188 23739 ts_tablet_manager.cc:1397] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.069s user 0.009s sys 0.005s
I20260807 13:38:30.490334 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:30.497373 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:30.498046 23479 raft_consensus.cc:3037] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:30.492540 23737 ts_tablet_manager.cc:1428] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.025s user 0.006s sys 0.001s
I20260807 13:38:30.499543 23737 tablet_bootstrap.cc:492] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:30.492592 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:30.500727 23581 raft_consensus.cc:2454] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:38:30.497429 23679 raft_consensus.cc:3037] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:30.501121 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:30.504174 23430 leader_election.cc:302] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
W20260807 13:38:30.503494 23532 leader_election.cc:341] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:30.506021 23746 raft_consensus.cc:2781] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:30.506402 23746 raft_consensus.cc:482] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:30.506799 23746 raft_consensus.cc:3037] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:30.510028 23737 tablet_bootstrap.cc:654] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:30.493096 23862 raft_consensus.cc:2781] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:30.510064 23479 raft_consensus.cc:2454] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:30.514845 23346 catalog_manager.cc:5495] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2). New cstate: current_term: 1 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:30.518571 23740 tablet_bootstrap.cc:492] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:30.520989 23739 raft_consensus.cc:348] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.514176 23862 raft_consensus.cc:686] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:30.521727 23740 ts_tablet_manager.cc:1397] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.056s user 0.021s sys 0.013s
I20260807 13:38:30.523193 23862 consensus_queue.cc:237] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.522578 23739 raft_consensus.cc:374] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:30.524415 23739 raft_consensus.cc:729] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:30.525107 23739 consensus_queue.cc:260] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.521554 23680 raft_consensus.cc:2454] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:30.526654 23532 leader_election.cc:302] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:30.527552 23740 raft_consensus.cc:348] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.528075 23794 raft_consensus.cc:2781] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:30.528276 23740 raft_consensus.cc:374] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:30.528296 23681 raft_consensus.cc:2454] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:30.528638 23794 raft_consensus.cc:686] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:30.528753 23740 raft_consensus.cc:729] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:30.529484 23679 raft_consensus.cc:2454] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:30.529477 23740 consensus_queue.cc:260] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.532143 23746 raft_consensus.cc:504] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.535910 23740 ts_tablet_manager.cc:1428] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.013s user 0.007s sys 0.000s
I20260807 13:38:30.536254 23746 leader_election.cc:288] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:30.536890 23740 tablet_bootstrap.cc:492] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:30.537025 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
W20260807 13:38:30.538429 23429 leader_election.cc:341] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:30.539109 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:30.531221 23739 ts_tablet_manager.cc:1428] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.038s user 0.005s sys 0.001s
I20260807 13:38:30.539791 23581 raft_consensus.cc:3037] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:30.540546 23739 tablet_bootstrap.cc:492] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:30.542115 23533 leader_election.cc:302] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:30.529570 23794 consensus_queue.cc:237] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.546767 23797 raft_consensus.cc:2781] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:30.550709 23740 tablet_bootstrap.cc:654] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:30.550654 23797 raft_consensus.cc:686] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:30.551121 23901 raft_consensus.cc:482] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:30.552640 23746 raft_consensus.cc:482] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:30.560782 23746 raft_consensus.cc:504] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.564513 23737 tablet_bootstrap.cc:492] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:30.565053 23737 ts_tablet_manager.cc:1397] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.066s user 0.012s sys 0.009s
I20260807 13:38:30.567880 23737 raft_consensus.cc:348] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.568663 23737 raft_consensus.cc:374] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:30.560010 23901 raft_consensus.cc:504] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.569662 23746 leader_election.cc:288] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:30.570395 23901 leader_election.cc:288] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:30.568691 23479 raft_consensus.cc:3037] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:30.572240 23737 raft_consensus.cc:729] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:30.572254 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:30.573316 23480 raft_consensus.cc:2379] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 1: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:30.573120 23797 consensus_queue.cc:237] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.573287 23737 consensus_queue.cc:260] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.574600 23796 consensus_queue.cc:1035] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:38:30.572466 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:30.576076 23737 ts_tablet_manager.cc:1428] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260807 13:38:30.576907 23737 tablet_bootstrap.cc:492] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:30.574064 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:30.581573 23633 leader_election.cc:302] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:30.582813 23901 raft_consensus.cc:3037] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:30.581688 23580 raft_consensus.cc:2454] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:38:30.586236 23430 leader_election.cc:302] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:30.587782 23774 raft_consensus.cc:2781] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:30.590149 23774 raft_consensus.cc:482] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:30.590529 23774 raft_consensus.cc:3037] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:30.592008 23581 raft_consensus.cc:2454] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:30.592826 23740 tablet_bootstrap.cc:492] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:30.593276 23740 ts_tablet_manager.cc:1397] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.057s user 0.015s sys 0.000s
I20260807 13:38:30.589859 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:30.596357 23739 tablet_bootstrap.cc:654] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:30.593732 23680 raft_consensus.cc:2454] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:38:30.593283 23430 leader_election.cc:302] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:30.594748 23346 catalog_manager.cc:5495] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2). New cstate: current_term: 1 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:30.598487 23346 catalog_manager.cc:5495] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2). New cstate: current_term: 1 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:30.622247 23746 raft_consensus.cc:2781] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:30.622900 23746 raft_consensus.cc:686] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:30.623842 23746 consensus_queue.cc:237] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.651062 23740 raft_consensus.cc:348] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.651927 23740 raft_consensus.cc:374] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:30.652189 23740 raft_consensus.cc:729] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:30.653182 23899 raft_consensus.cc:482] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:30.653046 23740 consensus_queue.cc:260] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.653944 23899 raft_consensus.cc:504] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.662766 23740 ts_tablet_manager.cc:1428] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.069s user 0.011s sys 0.011s
I20260807 13:38:30.662294 23346 catalog_manager.cc:5495] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2). New cstate: current_term: 1 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:30.657545 23899 leader_election.cc:288] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:30.668664 23774 raft_consensus.cc:504] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.670956 23737 tablet_bootstrap.cc:654] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:30.663599 23740 tablet_bootstrap.cc:492] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:30.676928 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:30.677809 23679 raft_consensus.cc:3037] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:30.673571 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:30.681990 23633 leader_election.cc:341] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:30.684535 23901 raft_consensus.cc:2726] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:30.675860 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:30.688187 23796 consensus_queue.cc:1035] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260807 13:38:30.689878 23631 leader_election.cc:341] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:30.690222 23631 leader_election.cc:302] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:30.690872 23901 raft_consensus.cc:2726] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:30.675304 23774 leader_election.cc:288] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:30.693794 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 100635us
I20260807 13:38:30.709942 23679 raft_consensus.cc:2454] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:30.712077 23739 tablet_bootstrap.cc:492] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:30.711934 23429 leader_election.cc:302] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:30.712580 23739 ts_tablet_manager.cc:1397] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.172s user 0.018s sys 0.017s
I20260807 13:38:30.712865 23746 raft_consensus.cc:2781] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:30.716487 23346 catalog_manager.cc:5495] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 0 to 1, leader changed from <none> to e11cad1eeaf5424c94e51241096f6613 (127.21.69.1). New cstate: current_term: 1 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:30.721290 23797 consensus_queue.cc:1035] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:30.723381 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:30.724128 23580 raft_consensus.cc:3037] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:30.715119 23746 raft_consensus.cc:686] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:30.731112 23739 raft_consensus.cc:348] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.731815 23739 raft_consensus.cc:374] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:30.732105 23739 raft_consensus.cc:729] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:30.732748 23739 consensus_queue.cc:260] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.749059 23862 raft_consensus.cc:482] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:30.749426 23746 consensus_queue.cc:237] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.749807 23862 raft_consensus.cc:504] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.752040 23774 raft_consensus.cc:482] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:30.809016 23580 raft_consensus.cc:2454] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:30.820081 23739 ts_tablet_manager.cc:1428] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.107s user 0.009s sys 0.000s
I20260807 13:38:30.822080 23739 tablet_bootstrap.cc:492] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:30.813714 23862 leader_election.cc:288] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:30.816020 23774 raft_consensus.cc:504] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.837590 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:30.838346 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:30.840095 23532 leader_election.cc:341] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:30.840735 23774 leader_election.cc:288] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:30.843560 23740 tablet_bootstrap.cc:654] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:30.854445 23737 tablet_bootstrap.cc:492] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:30.854995 23737 ts_tablet_manager.cc:1397] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.278s user 0.005s sys 0.024s
I20260807 13:38:30.865809 23739 tablet_bootstrap.cc:654] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
W20260807 13:38:30.858827 23533 leader_election.cc:341] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:30.861068 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:30.870425 23533 leader_election.cc:302] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:30.871265 23796 raft_consensus.cc:2726] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:30.872004 23679 raft_consensus.cc:2454] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:30.873716 23862 consensus_queue.cc:1035] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:38:30.875638 23346 catalog_manager.cc:5495] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 0 to 1, leader changed from <none> to e11cad1eeaf5424c94e51241096f6613 (127.21.69.1). New cstate: current_term: 1 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:30.876983 23429 leader_election.cc:302] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:30.879830 23774 raft_consensus.cc:2781] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:30.880277 23774 raft_consensus.cc:482] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:30.880808 23774 raft_consensus.cc:3037] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:30.882133 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:30.907243 23737 raft_consensus.cc:348] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.909356 23901 raft_consensus.cc:482] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:30.909888 23901 raft_consensus.cc:504] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.912112 23901 leader_election.cc:288] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:30.914451 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:30.915227 23580 raft_consensus.cc:2454] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 0.
I20260807 13:38:30.917119 23948 consensus_queue.cc:1035] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:38:30.917953 23633 leader_election.cc:302] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:30.918890 23901 raft_consensus.cc:2781] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:30.919289 23901 raft_consensus.cc:482] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:30.919682 23901 raft_consensus.cc:3037] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:30.922976 23774 raft_consensus.cc:504] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.921799 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:30.953501 23740 tablet_bootstrap.cc:492] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
W20260807 13:38:30.954461 23631 leader_election.cc:341] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:30.955080 23740 ts_tablet_manager.cc:1397] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.292s user 0.035s sys 0.033s
I20260807 13:38:30.928593 23901 raft_consensus.cc:504] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.958300 23740 raft_consensus.cc:348] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.959307 23740 raft_consensus.cc:374] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:30.959633 23740 raft_consensus.cc:729] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:30.959885 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:30.960511 23580 raft_consensus.cc:3037] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:30.960323 23740 consensus_queue.cc:260] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.921276 23737 raft_consensus.cc:374] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:30.954330 23774 leader_election.cc:288] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:30.963011 23740 ts_tablet_manager.cc:1428] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260807 13:38:30.964022 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:30.963989 23737 raft_consensus.cc:729] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:30.963404 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:30.965903 23740 tablet_bootstrap.cc:492] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
W20260807 13:38:30.965855 23631 leader_election.cc:341] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:30.970453 23901 leader_election.cc:288] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:30.970065 23580 raft_consensus.cc:2454] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:30.978744 23633 leader_election.cc:302] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:30.980382 23901 raft_consensus.cc:2781] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:30.981178 23901 raft_consensus.cc:686] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:30.982165 23901 consensus_queue.cc:237] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.982700 23481 raft_consensus.cc:1226] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:30.988565 23796 consensus_queue.cc:1035] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:38:30.975963 23737 consensus_queue.cc:260] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:30.991257 23737 ts_tablet_manager.cc:1428] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.136s user 0.000s sys 0.008s
I20260807 13:38:30.995261 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:31.003086 23481 raft_consensus.cc:3037] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:30.996029 23794 consensus_queue.cc:1046] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:38:31.004803 23948 raft_consensus.cc:3032] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:31.005188 23948 raft_consensus.cc:729] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:31.006016 23948 consensus_queue.cc:260] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.009337 23797 consensus_queue.cc:1035] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:31.015094 23948 raft_consensus.cc:3037] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:31.022912 23737 tablet_bootstrap.cc:492] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:31.022692 23797 raft_consensus.cc:482] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:31.027361 23797 raft_consensus.cc:504] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.030390 23797 leader_election.cc:288] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:31.018267 23430 leader_election.cc:302] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:31.033012 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:31.122504 23737 tablet_bootstrap.cc:654] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:31.052716 23739 tablet_bootstrap.cc:492] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:31.040134 23740 tablet_bootstrap.cc:654] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:31.052987 23797 consensus_queue.cc:1035] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260807 13:38:31.266721 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 248612us
I20260807 13:38:31.339593 23948 consensus_queue.cc:1035] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:31.341053 23740 tablet_bootstrap.cc:492] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:31.341552 23740 ts_tablet_manager.cc:1397] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.376s user 0.005s sys 0.008s
I20260807 13:38:31.344324 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:31.344309 23740 raft_consensus.cc:348] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.346462 23740 raft_consensus.cc:374] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:31.346771 23740 raft_consensus.cc:729] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:31.348775 23740 consensus_queue.cc:260] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.269872 23970 raft_consensus.cc:2726] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:31.284703 23774 raft_consensus.cc:482] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:31.350970 23774 raft_consensus.cc:504] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:31.316825 23429 consensus_peers.cc:487] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 -> Peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Couldn't send request to peer 5e0ea5aa0c6d4846a5ccc9962342e17a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:38:31.352658 23740 ts_tablet_manager.cc:1428] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.011s user 0.007s sys 0.000s
I20260807 13:38:31.353657 23740 tablet_bootstrap.cc:492] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:31.354453 23774 leader_election.cc:288] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:31.319203 23407 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:38:31.320184 23968 raft_consensus.cc:482] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:31.333652 23739 ts_tablet_manager.cc:1397] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.512s user 0.020s sys 0.012s
I20260807 13:38:31.355952 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:31.357671 23796 consensus_queue.cc:1035] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:38:31.358490 23739 raft_consensus.cc:348] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.359249 23739 raft_consensus.cc:374] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:31.360236 23739 raft_consensus.cc:729] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
W20260807 13:38:31.333786 23533 leader_election.cc:341] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:31.359011 23796 consensus_queue.cc:1035] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:38:31.363152 23532 leader_election.cc:341] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:31.362986 23968 raft_consensus.cc:504] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.367470 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:31.368957 23739 consensus_queue.cc:260] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.368230 23580 raft_consensus.cc:2454] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 0.
I20260807 13:38:31.374447 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:31.374696 23532 leader_election.cc:302] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:31.375622 23633 leader_election.cc:302] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:31.376230 23796 raft_consensus.cc:2726] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:31.377024 23901 raft_consensus.cc:2781] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:31.377411 23901 raft_consensus.cc:482] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:31.377756 23901 raft_consensus.cc:3037] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:38:31.380206 23631 leader_election.cc:341] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:31.370111 23968 leader_election.cc:288] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:31.388134 23739 ts_tablet_manager.cc:1428] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.032s user 0.006s sys 0.001s
I20260807 13:38:31.389029 23739 tablet_bootstrap.cc:492] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:31.402210 23942 consensus_queue.cc:1035] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:31.404673 23345 catalog_manager.cc:5495] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3). New cstate: current_term: 1 leader_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: HEALTHY } } }
W20260807 13:38:31.409787 23532 consensus_peers.cc:487] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 -> Peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Couldn't send request to peer e11cad1eeaf5424c94e51241096f6613. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:38:31.417932 23737 tablet_bootstrap.cc:492] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:31.418669 23737 ts_tablet_manager.cc:1397] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.396s user 0.022s sys 0.021s
I20260807 13:38:31.417402 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:31.429654 23739 tablet_bootstrap.cc:654] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:31.430572 23479 raft_consensus.cc:3037] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:31.431301 23899 consensus_queue.cc:1035] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:38:31.435729 23774 consensus_queue.cc:1035] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:31.424350 23901 raft_consensus.cc:504] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.439311 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:31.420780 23740 tablet_bootstrap.cc:654] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:31.443442 23774 consensus_queue.cc:1035] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:38:31.443746 23631 leader_election.cc:341] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:31.456853 23737 raft_consensus.cc:348] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.457933 23737 raft_consensus.cc:374] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:31.458204 23737 raft_consensus.cc:729] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:31.458268 23774 raft_consensus.cc:482] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:31.458752 23774 raft_consensus.cc:504] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.458870 23737 consensus_queue.cc:260] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.476116 23899 consensus_queue.cc:1035] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:31.468698 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:31.468871 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:31.481222 23580 raft_consensus.cc:3037] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:31.462400 23774 leader_election.cc:288] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:31.468422 23430 leader_election.cc:302] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:31.489475 23774 raft_consensus.cc:2726] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:31.492528 23737 ts_tablet_manager.cc:1428] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.073s user 0.008s sys 0.003s
I20260807 13:38:31.493398 23737 tablet_bootstrap.cc:492] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:31.467831 23901 leader_election.cc:288] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:31.507395 23737 tablet_bootstrap.cc:654] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:31.512784 23740 tablet_bootstrap.cc:492] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:31.513343 23740 ts_tablet_manager.cc:1397] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.160s user 0.013s sys 0.004s
I20260807 13:38:31.515836 23740 raft_consensus.cc:348] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.516650 23740 raft_consensus.cc:374] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:31.517014 23740 raft_consensus.cc:729] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:31.519027 23740 consensus_queue.cc:260] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.519860 23580 raft_consensus.cc:2454] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:31.521850 23633 leader_election.cc:302] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:31.523307 23901 raft_consensus.cc:2781] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:31.523918 23901 raft_consensus.cc:686] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:31.524786 23901 consensus_queue.cc:237] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.533058 23740 ts_tablet_manager.cc:1428] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.019s user 0.008s sys 0.000s
I20260807 13:38:31.534416 23740 tablet_bootstrap.cc:492] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:31.540215 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:31.553452 23968 raft_consensus.cc:482] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:31.554456 23968 raft_consensus.cc:504] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.558254 23968 leader_election.cc:288] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:31.575434 23430 leader_election.cc:302] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:31.576992 23970 raft_consensus.cc:2726] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:31.578024 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:31.579552 23633 leader_election.cc:341] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:31.581280 23739 tablet_bootstrap.cc:492] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:31.581775 23739 ts_tablet_manager.cc:1397] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.193s user 0.016s sys 0.010s
I20260807 13:38:31.582870 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:31.584576 23631 leader_election.cc:341] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:31.585312 23740 tablet_bootstrap.cc:654] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:31.584888 23739 raft_consensus.cc:348] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.585130 23631 leader_election.cc:302] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:31.585675 23739 raft_consensus.cc:374] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:31.585970 23739 raft_consensus.cc:729] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:31.586292 23968 raft_consensus.cc:2726] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:31.593972 23739 consensus_queue.cc:260] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.596383 23740 tablet_bootstrap.cc:492] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:31.596689 23739 ts_tablet_manager.cc:1428] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.015s user 0.009s sys 0.000s
I20260807 13:38:31.596881 23740 ts_tablet_manager.cc:1397] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.063s user 0.012s sys 0.000s
I20260807 13:38:31.598068 23739 tablet_bootstrap.cc:492] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:31.600018 23740 raft_consensus.cc:348] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.600765 23740 raft_consensus.cc:374] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:31.601055 23740 raft_consensus.cc:729] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:31.601985 23740 consensus_queue.cc:260] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.604703 23740 ts_tablet_manager.cc:1428] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260807 13:38:31.605476 23739 tablet_bootstrap.cc:654] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:31.605720 23740 tablet_bootstrap.cc:492] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:31.612640 23739 tablet_bootstrap.cc:492] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:31.613901 23739 ts_tablet_manager.cc:1397] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.003s
I20260807 13:38:31.615899 23740 tablet_bootstrap.cc:654] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:31.616040 23737 tablet_bootstrap.cc:492] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:31.616541 23737 ts_tablet_manager.cc:1397] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.123s user 0.024s sys 0.021s
I20260807 13:38:31.616791 23739 raft_consensus.cc:348] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.617725 23739 raft_consensus.cc:374] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:31.618029 23739 raft_consensus.cc:729] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:31.620251 23739 consensus_queue.cc:260] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.623952 23739 ts_tablet_manager.cc:1428] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260807 13:38:31.624807 23739 tablet_bootstrap.cc:492] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:31.628134 23345 catalog_manager.cc:5495] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3). New cstate: current_term: 1 leader_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: HEALTHY } } }
I20260807 13:38:31.630568 23739 tablet_bootstrap.cc:654] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:31.632041 23737 raft_consensus.cc:348] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.635668 23737 raft_consensus.cc:374] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:31.638589 23737 raft_consensus.cc:729] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:31.639438 23737 consensus_queue.cc:260] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.641863 23737 ts_tablet_manager.cc:1428] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.025s user 0.006s sys 0.001s
I20260807 13:38:31.642910 23737 tablet_bootstrap.cc:492] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:31.643355 23740 tablet_bootstrap.cc:492] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:31.643692 23739 tablet_bootstrap.cc:492] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:31.643888 23740 ts_tablet_manager.cc:1397] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.038s user 0.012s sys 0.003s
I20260807 13:38:31.644162 23739 ts_tablet_manager.cc:1397] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.010s
I20260807 13:38:31.647145 23739 raft_consensus.cc:348] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.647298 23740 raft_consensus.cc:348] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.647964 23739 raft_consensus.cc:374] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:31.648090 23740 raft_consensus.cc:374] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:31.648300 23739 raft_consensus.cc:729] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:31.648427 23740 raft_consensus.cc:729] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:31.649021 23739 consensus_queue.cc:260] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.649080 23740 consensus_queue.cc:260] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.650025 23737 tablet_bootstrap.cc:654] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:31.651418 23739 ts_tablet_manager.cc:1428] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260807 13:38:31.651492 23740 ts_tablet_manager.cc:1428] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 13:38:31.652509 23739 tablet_bootstrap.cc:492] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:31.652534 23740 tablet_bootstrap.cc:492] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:31.660094 23740 tablet_bootstrap.cc:654] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:31.661726 23739 tablet_bootstrap.cc:654] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:31.664108 23970 raft_consensus.cc:482] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:31.664740 23970 raft_consensus.cc:504] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.666167 23737 tablet_bootstrap.cc:492] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:31.666826 23737 ts_tablet_manager.cc:1397] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.024s user 0.012s sys 0.008s
I20260807 13:38:31.667181 23970 leader_election.cc:288] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:31.668438 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:31.668762 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:31.669142 23681 raft_consensus.cc:2454] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
W20260807 13:38:31.670167 23430 leader_election.cc:341] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:31.670832 23429 leader_election.cc:302] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters: 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:31.670161 23737 raft_consensus.cc:348] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.671710 23970 raft_consensus.cc:2781] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:31.670610 23740 tablet_bootstrap.cc:492] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:31.672230 23970 raft_consensus.cc:482] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:31.672437 23740 ts_tablet_manager.cc:1397] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.020s user 0.012s sys 0.001s
I20260807 13:38:31.672802 23970 raft_consensus.cc:3037] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:31.671625 23737 raft_consensus.cc:374] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:31.673503 23737 raft_consensus.cc:729] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:31.674475 23737 consensus_queue.cc:260] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.675343 23740 raft_consensus.cc:348] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.676106 23740 raft_consensus.cc:374] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:31.676373 23740 raft_consensus.cc:729] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:31.677058 23740 consensus_queue.cc:260] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.679857 23740 ts_tablet_manager.cc:1428] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260807 13:38:31.680821 23740 tablet_bootstrap.cc:492] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:31.686919 23740 tablet_bootstrap.cc:654] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:31.689703 23737 ts_tablet_manager.cc:1428] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.023s user 0.008s sys 0.002s
I20260807 13:38:31.693193 23739 tablet_bootstrap.cc:492] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:31.693804 23739 ts_tablet_manager.cc:1397] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.041s user 0.030s sys 0.008s
I20260807 13:38:31.694185 23740 tablet_bootstrap.cc:492] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:31.694661 23740 ts_tablet_manager.cc:1397] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.004s
I20260807 13:38:31.696728 23739 raft_consensus.cc:348] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.696794 23970 raft_consensus.cc:504] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.697629 23739 raft_consensus.cc:374] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:31.697944 23739 raft_consensus.cc:729] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:31.698272 23740 raft_consensus.cc:348] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.698567 23739 consensus_queue.cc:260] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.699229 23740 raft_consensus.cc:374] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:31.699542 23740 raft_consensus.cc:729] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:31.700186 23740 consensus_queue.cc:260] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.700762 23739 ts_tablet_manager.cc:1428] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 13:38:31.702478 23739 tablet_bootstrap.cc:492] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:31.700711 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:31.703336 23740 ts_tablet_manager.cc:1428] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.008s user 0.006s sys 0.001s
I20260807 13:38:31.705353 23740 tablet_bootstrap.cc:492] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
W20260807 13:38:31.708432 23430 leader_election.cc:341] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:31.709550 23739 tablet_bootstrap.cc:654] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:31.705356 23737 tablet_bootstrap.cc:492] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:31.711254 23740 tablet_bootstrap.cc:654] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:31.720877 23737 tablet_bootstrap.cc:654] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:31.727478 23740 tablet_bootstrap.cc:492] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:31.728024 23740 ts_tablet_manager.cc:1397] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.023s user 0.017s sys 0.000s
I20260807 13:38:31.730435 23901 raft_consensus.cc:482] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:31.730465 23740 raft_consensus.cc:348] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.731348 23740 raft_consensus.cc:374] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:31.731033 23901 raft_consensus.cc:504] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.731623 23740 raft_consensus.cc:729] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:31.732877 23740 consensus_queue.cc:260] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.733217 23901 leader_election.cc:288] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:31.735668 23740 ts_tablet_manager.cc:1428] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.007s user 0.002s sys 0.004s
I20260807 13:38:31.736045 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:31.736598 23740 tablet_bootstrap.cc:492] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
W20260807 13:38:31.737547 23631 leader_election.cc:341] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:31.738111 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:31.742201 23633 leader_election.cc:341] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:31.742736 23633 leader_election.cc:302] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:31.743321 23740 tablet_bootstrap.cc:654] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:31.744021 23901 raft_consensus.cc:2726] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:31.745441 23796 raft_consensus.cc:482] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:31.745930 23796 raft_consensus.cc:504] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.753640 23737 tablet_bootstrap.cc:492] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:31.755242 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:31.757359 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:31.754254 23737 ts_tablet_manager.cc:1397] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.049s user 0.016s sys 0.003s
W20260807 13:38:31.758113 23533 leader_election.cc:341] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:31.758267 23970 leader_election.cc:288] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:31.761358 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:31.762044 23480 raft_consensus.cc:2454] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:31.762490 23740 tablet_bootstrap.cc:492] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:31.762476 23737 raft_consensus.cc:348] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.763051 23740 ts_tablet_manager.cc:1397] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.027s user 0.013s sys 0.012s
I20260807 13:38:31.763315 23737 raft_consensus.cc:374] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:31.763633 23737 raft_consensus.cc:729] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:31.764300 23737 consensus_queue.cc:260] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.765816 23532 leader_election.cc:302] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:31.766582 23737 ts_tablet_manager.cc:1428] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20260807 13:38:31.766207 23740 raft_consensus.cc:348] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.766808 23797 raft_consensus.cc:2781] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:31.766986 23740 raft_consensus.cc:374] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:31.767230 23797 raft_consensus.cc:482] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:31.767323 23740 raft_consensus.cc:729] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:31.767715 23797 raft_consensus.cc:3037] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:31.758167 23681 raft_consensus.cc:3037] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:31.768141 23740 consensus_queue.cc:260] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.770094 23740 ts_tablet_manager.cc:1428] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20260807 13:38:31.770469 23948 raft_consensus.cc:482] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:31.770958 23740 tablet_bootstrap.cc:492] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:31.770974 23948 raft_consensus.cc:504] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.771806 23796 leader_election.cc:288] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:31.775840 23681 raft_consensus.cc:2454] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:31.775974 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:31.776962 23740 tablet_bootstrap.cc:654] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:31.777341 23429 leader_election.cc:302] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters: 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:31.776974 23948 leader_election.cc:288] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:31.778774 23970 raft_consensus.cc:2781] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:31.779312 23970 raft_consensus.cc:686] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
W20260807 13:38:31.777559 23532 leader_election.cc:341] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:31.780252 23970 consensus_queue.cc:237] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.780794 23739 tablet_bootstrap.cc:492] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:31.781616 23739 ts_tablet_manager.cc:1397] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.079s user 0.023s sys 0.015s
I20260807 13:38:31.785408 23739 raft_consensus.cc:348] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.803256 23739 raft_consensus.cc:374] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:31.803674 23739 raft_consensus.cc:729] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:31.798933 23797 raft_consensus.cc:504] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.799904 23948 raft_consensus.cc:482] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:31.806988 23948 raft_consensus.cc:504] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.808036 23740 tablet_bootstrap.cc:492] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:31.808527 23740 ts_tablet_manager.cc:1397] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.038s user 0.021s sys 0.012s
I20260807 13:38:31.802834 23737 tablet_bootstrap.cc:492] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:31.787688 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:31.808990 23948 leader_election.cc:288] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:31.805361 23739 consensus_queue.cc:260] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.805980 23797 leader_election.cc:288] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:31.811249 23533 leader_election.cc:341] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:31.811725 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:31.811837 23533 leader_election.cc:302] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:31.812482 23480 raft_consensus.cc:3037] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:31.813079 23797 raft_consensus.cc:2726] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:31.814788 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:31.814917 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:31.815811 23740 raft_consensus.cc:348] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:31.816314 23533 leader_election.cc:341] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:31.816557 23740 raft_consensus.cc:374] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:31.816839 23740 raft_consensus.cc:729] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:31.817482 23740 consensus_queue.cc:260] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.812505 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:31.818816 23684 raft_consensus.cc:3037] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:31.819784 23740 ts_tablet_manager.cc:1428] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.011s user 0.007s sys 0.000s
I20260807 13:38:31.820811 23740 tablet_bootstrap.cc:492] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
W20260807 13:38:31.824453 23532 leader_election.cc:341] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:31.824180 23345 catalog_manager.cc:5495] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 0 to 1, leader changed from <none> to e11cad1eeaf5424c94e51241096f6613 (127.21.69.1). New cstate: current_term: 1 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:31.824962 23532 leader_election.cc:302] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:31.826114 23948 raft_consensus.cc:2726] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:31.826846 23740 tablet_bootstrap.cc:654] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:31.826583 23737 tablet_bootstrap.cc:654] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:31.828986 23797 raft_consensus.cc:482] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:31.831935 23797 raft_consensus.cc:504] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.834117 23797 leader_election.cc:288] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:31.837409 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:31.840036 23681 raft_consensus.cc:2454] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:31.840833 23480 raft_consensus.cc:2454] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:31.841341 23533 leader_election.cc:302] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:31.842180 23948 raft_consensus.cc:2781] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:31.842546 23948 raft_consensus.cc:482] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:31.839939 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:31.842883 23948 raft_consensus.cc:3037] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:31.844012 23532 leader_election.cc:302] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
W20260807 13:38:31.844935 23532 leader_election.cc:341] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:31.846372 23796 raft_consensus.cc:2781] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:31.846909 23796 raft_consensus.cc:686] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:31.847820 23796 consensus_queue.cc:237] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.851109 23969 raft_consensus.cc:482] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:31.851615 23969 raft_consensus.cc:504] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.853752 23969 leader_election.cc:288] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:31.855758 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:31.856634 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:31.857707 23533 leader_election.cc:341] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:38:31.859826 23532 leader_election.cc:341] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:31.860298 23532 leader_election.cc:302] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:31.861109 23797 raft_consensus.cc:2726] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:31.826222 23684 raft_consensus.cc:2454] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:31.830847 23739 ts_tablet_manager.cc:1428] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.049s user 0.007s sys 0.000s
I20260807 13:38:31.872120 23739 tablet_bootstrap.cc:492] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:31.863615 23948 raft_consensus.cc:504] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.883883 23948 leader_election.cc:288] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:31.892086 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:31.892841 23684 raft_consensus.cc:3037] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:31.893642 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:31.896111 23740 tablet_bootstrap.cc:492] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:31.900785 23740 ts_tablet_manager.cc:1397] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.080s user 0.035s sys 0.006s
I20260807 13:38:31.899266 23345 catalog_manager.cc:5495] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2). New cstate: current_term: 1 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:31.902325 23684 raft_consensus.cc:2454] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:31.907604 23737 tablet_bootstrap.cc:492] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:31.910727 23901 raft_consensus.cc:482] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:31.903858 23740 raft_consensus.cc:348] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.911351 23901 raft_consensus.cc:504] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.912290 23740 raft_consensus.cc:374] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:31.912606 23740 raft_consensus.cc:729] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:31.913254 23740 consensus_queue.cc:260] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.910821 23737 ts_tablet_manager.cc:1397] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.108s user 0.017s sys 0.003s
I20260807 13:38:31.916122 23740 ts_tablet_manager.cc:1428] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.015s user 0.006s sys 0.000s
I20260807 13:38:31.915937 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:31.908815 23533 leader_election.cc:302] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
W20260807 13:38:31.917361 23631 leader_election.cc:341] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:31.919670 23737 raft_consensus.cc:348] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.920099 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:31.920809 23737 raft_consensus.cc:374] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:31.921000 23581 raft_consensus.cc:2454] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 0.
I20260807 13:38:31.921769 23740 tablet_bootstrap.cc:492] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:31.922345 23796 raft_consensus.cc:482] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:31.922480 23633 leader_election.cc:302] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:31.923388 23968 raft_consensus.cc:2781] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:31.921649 23797 raft_consensus.cc:2781] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:31.923820 23968 raft_consensus.cc:482] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:31.923103 23796 raft_consensus.cc:504] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.924203 23968 raft_consensus.cc:3037] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:31.924849 23797 raft_consensus.cc:686] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:31.926043 23797 consensus_queue.cc:237] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.927373 23796 leader_election.cc:288] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:31.928025 23532 leader_election.cc:341] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:31.928723 23740 tablet_bootstrap.cc:654] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:31.931711 23737 raft_consensus.cc:729] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:31.932667 23737 consensus_queue.cc:260] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.909229 23739 tablet_bootstrap.cc:654] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:31.932039 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:31.935600 23737 ts_tablet_manager.cc:1428] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.021s user 0.006s sys 0.001s
I20260807 13:38:31.937001 23737 tablet_bootstrap.cc:492] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
W20260807 13:38:31.937008 23533 leader_election.cc:341] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:31.938813 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:31.941285 23901 leader_election.cc:288] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:31.942929 23970 raft_consensus.cc:482] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:31.943536 23737 tablet_bootstrap.cc:654] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:31.943661 23970 raft_consensus.cc:504] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.948010 23970 leader_election.cc:288] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:31.948227 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:31.949988 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:31.950901 23581 raft_consensus.cc:2379] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 1: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:31.953178 23429 leader_election.cc:302] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:31.957095 23774 raft_consensus.cc:3037] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:31.957652 23739 tablet_bootstrap.cc:492] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:31.958256 23739 ts_tablet_manager.cc:1397] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.086s user 0.007s sys 0.011s
I20260807 13:38:31.962023 23739 raft_consensus.cc:348] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.962934 23739 raft_consensus.cc:374] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:31.963267 23739 raft_consensus.cc:729] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:31.964015 23739 consensus_queue.cc:260] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.966602 23739 ts_tablet_manager.cc:1428] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260807 13:38:31.967566 23774 raft_consensus.cc:2726] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:31.967852 23739 tablet_bootstrap.cc:492] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:31.971573 23740 tablet_bootstrap.cc:492] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:31.972219 23740 ts_tablet_manager.cc:1397] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.051s user 0.024s sys 0.002s
I20260807 13:38:31.974502 23739 tablet_bootstrap.cc:654] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:31.976440 23740 raft_consensus.cc:348] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.977496 23740 raft_consensus.cc:374] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:31.977816 23740 raft_consensus.cc:729] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:31.978638 23740 consensus_queue.cc:260] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.982167 23737 tablet_bootstrap.cc:492] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:31.982661 23737 ts_tablet_manager.cc:1397] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.046s user 0.008s sys 0.011s
W20260807 13:38:31.983469 23532 leader_election.cc:341] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:31.985121 23968 raft_consensus.cc:504] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.987044 23739 tablet_bootstrap.cc:492] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:31.987766 23739 ts_tablet_manager.cc:1397] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.020s user 0.011s sys 0.007s
I20260807 13:38:31.988677 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:31.986977 23740 ts_tablet_manager.cc:1428] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.014s user 0.008s sys 0.001s
I20260807 13:38:31.990542 23740 tablet_bootstrap.cc:492] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:31.985219 23737 raft_consensus.cc:348] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.991984 23899 consensus_queue.cc:1035] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:31.991988 23737 raft_consensus.cc:374] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:31.993075 23737 raft_consensus.cc:729] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:31.993358 23739 raft_consensus.cc:348] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.994333 23739 raft_consensus.cc:374] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:31.994128 23737 consensus_queue.cc:260] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:31.994807 23739 raft_consensus.cc:729] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:31.996241 23739 consensus_queue.cc:260] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:31.994320 23631 leader_election.cc:341] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:32.003393 23739 ts_tablet_manager.cc:1428] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.015s user 0.005s sys 0.004s
I20260807 13:38:31.984090 23532 leader_election.cc:302] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:32.004645 23739 tablet_bootstrap.cc:492] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:32.015367 23968 leader_election.cc:288] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:32.021427 23969 raft_consensus.cc:2726] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:32.016357 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:32.022563 23581 raft_consensus.cc:3037] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:32.003633 23740 tablet_bootstrap.cc:654] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:32.007304 23774 raft_consensus.cc:482] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:32.009788 23737 ts_tablet_manager.cc:1428] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.027s user 0.012s sys 0.003s
I20260807 13:38:32.034061 23737 tablet_bootstrap.cc:492] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:32.032277 23581 raft_consensus.cc:2454] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:32.038786 23948 raft_consensus.cc:482] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:32.032923 23774 raft_consensus.cc:504] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.039372 23633 leader_election.cc:302] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:32.039392 23948 raft_consensus.cc:504] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.043951 23948 leader_election.cc:288] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:32.045047 23968 raft_consensus.cc:2781] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:32.045689 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:32.045723 23968 raft_consensus.cc:686] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:32.047353 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:32.047302 23968 consensus_queue.cc:237] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.048548 23774 leader_election.cc:288] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:32.049839 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:32.052048 23684 raft_consensus.cc:2379] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 1: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:32.053227 23739 tablet_bootstrap.cc:654] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:32.054972 23737 tablet_bootstrap.cc:654] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:32.060336 23430 leader_election.cc:302] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:32.061825 23774 raft_consensus.cc:2726] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:32.074651 23342 catalog_manager.cc:5495] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3). New cstate: current_term: 1 leader_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: HEALTHY } } }
I20260807 13:38:32.077853 23740 tablet_bootstrap.cc:492] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:32.078383 23740 ts_tablet_manager.cc:1397] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.088s user 0.006s sys 0.028s
I20260807 13:38:32.078493 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:32.080188 23481 raft_consensus.cc:3037] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:32.081054 23740 raft_consensus.cc:348] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.081782 23740 raft_consensus.cc:374] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:32.082074 23740 raft_consensus.cc:729] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:32.082796 23740 consensus_queue.cc:260] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.085518 23740 ts_tablet_manager.cc:1428] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20260807 13:38:32.086505 23740 tablet_bootstrap.cc:492] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:32.087559 23532 leader_election.cc:302] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:32.088933 23797 raft_consensus.cc:3037] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:32.095865 23345 catalog_manager.cc:5495] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2). New cstate: current_term: 1 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:32.100284 23797 raft_consensus.cc:2726] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:32.107452 23737 tablet_bootstrap.cc:492] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:32.108006 23740 tablet_bootstrap.cc:654] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:32.108040 23737 ts_tablet_manager.cc:1397] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.074s user 0.011s sys 0.007s
I20260807 13:38:32.109377 24030 consensus_queue.cc:1035] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:32.111204 23797 raft_consensus.cc:482] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:32.112030 23739 tablet_bootstrap.cc:492] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:32.111763 23797 raft_consensus.cc:504] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.112506 23739 ts_tablet_manager.cc:1397] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.108s user 0.023s sys 0.011s
I20260807 13:38:32.116756 23970 raft_consensus.cc:482] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:32.117341 23970 raft_consensus.cc:504] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.121984 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:32.122570 23737 raft_consensus.cc:348] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.123942 23737 raft_consensus.cc:374] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:32.124356 23737 raft_consensus.cc:729] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:32.125216 23737 consensus_queue.cc:260] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.132530 23737 ts_tablet_manager.cc:1428] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.024s user 0.007s sys 0.001s
I20260807 13:38:32.123613 23797 leader_election.cc:288] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:32.133777 23737 tablet_bootstrap.cc:492] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:32.134969 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:32.135365 23533 leader_election.cc:341] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:38:32.144166 23532 leader_election.cc:341] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:32.144694 23532 leader_election.cc:302] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:32.145628 24030 raft_consensus.cc:482] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:32.145730 23948 raft_consensus.cc:2726] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:32.151899 24030 raft_consensus.cc:504] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.152745 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:32.153453 23581 raft_consensus.cc:2454] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:38:32.154245 24030 leader_election.cc:288] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:32.145866 23970 leader_election.cc:288] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:32.155180 23430 leader_election.cc:302] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:32.155717 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:32.156384 23968 raft_consensus.cc:482] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:32.156831 23970 raft_consensus.cc:2781] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:32.157336 23970 raft_consensus.cc:482] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:32.156900 23968 raft_consensus.cc:504] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.157676 23970 raft_consensus.cc:3037] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:32.157864 23739 raft_consensus.cc:348] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.158591 23739 raft_consensus.cc:374] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:32.158849 23739 raft_consensus.cc:729] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:32.161757 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:32.159505 23739 consensus_queue.cc:260] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:32.162195 23631 leader_election.cc:341] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:38:32.245584 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 83449.9us
I20260807 13:38:32.246282 23740 tablet_bootstrap.cc:492] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:32.246798 23740 ts_tablet_manager.cc:1397] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.161s user 0.017s sys 0.005s
W20260807 13:38:32.247176 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 103884us
I20260807 13:38:32.244716 23968 leader_election.cc:288] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:32.191076 23948 raft_consensus.cc:482] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:32.182611 23509 debug-util.cc:398] Leaking SignalData structure 0x7b080011f740 after lost signal to thread 21785
I20260807 13:38:32.242254 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:32.230163 23970 raft_consensus.cc:504] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.182529 23582 raft_consensus.cc:2454] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 0.
I20260807 13:38:32.196295 23774 raft_consensus.cc:482] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:32.261034 23739 ts_tablet_manager.cc:1428] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.148s user 0.006s sys 0.006s
I20260807 13:38:32.260632 23774 raft_consensus.cc:504] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:32.261854 23509 debug-util.cc:398] Leaking SignalData structure 0x7b08001a0340 after lost signal to thread 23392
I20260807 13:38:32.263118 23739 tablet_bootstrap.cc:492] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:32.254014 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:32.249317 23740 raft_consensus.cc:348] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.265868 23740 raft_consensus.cc:374] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:32.266203 23740 raft_consensus.cc:729] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:32.267150 23740 consensus_queue.cc:260] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.264904 23684 raft_consensus.cc:2454] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:38:32.270167 23633 leader_election.cc:302] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:32.272151 23774 leader_election.cc:288] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:32.272658 23796 raft_consensus.cc:482] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:32.273036 24030 raft_consensus.cc:2781] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:32.273443 24030 raft_consensus.cc:482] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:32.273134 23796 raft_consensus.cc:504] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.273780 24030 raft_consensus.cc:3037] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:32.268724 23581 raft_consensus.cc:2454] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 0.
I20260807 13:38:32.275238 23796 leader_election.cc:288] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:32.277329 23633 leader_election.cc:302] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:32.277406 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:32.277798 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:32.278659 23899 raft_consensus.cc:2781] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260807 13:38:32.278884 23533 leader_election.cc:341] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:32.279048 23899 raft_consensus.cc:482] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:32.279421 23899 raft_consensus.cc:3037] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:32.259577 23948 raft_consensus.cc:504] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.281983 23740 ts_tablet_manager.cc:1428] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.035s user 0.011s sys 0.000s
I20260807 13:38:32.282799 23740 tablet_bootstrap.cc:492] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
W20260807 13:38:32.270756 23509 debug-util.cc:398] Leaking SignalData structure 0x7b080004bf40 after lost signal to thread 23513
W20260807 13:38:32.286449 23509 debug-util.cc:398] Leaking SignalData structure 0x7b08002528a0 after lost signal to thread 23613
I20260807 13:38:32.286911 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:32.287482 23509 debug-util.cc:398] Leaking SignalData structure 0x7b080014e380 after lost signal to thread 23714
W20260807 13:38:32.288558 23532 leader_election.cc:341] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:32.296496 23737 tablet_bootstrap.cc:654] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:32.302580 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:32.297152 23899 raft_consensus.cc:504] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.309676 23581 raft_consensus.cc:3037] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:32.285593 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:32.308072 23970 leader_election.cc:288] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:32.312430 23582 raft_consensus.cc:2454] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:38:32.298523 23948 leader_election.cc:288] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:32.312744 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:32.313500 23684 raft_consensus.cc:3037] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:32.314213 23739 tablet_bootstrap.cc:654] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:32.298717 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:32.318727 23480 raft_consensus.cc:2454] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 0.
I20260807 13:38:32.293311 24030 raft_consensus.cc:504] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.315536 23532 leader_election.cc:302] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:32.319056 23430 leader_election.cc:302] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:32.322593 23681 raft_consensus.cc:2379] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 1: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:32.324831 23942 raft_consensus.cc:2781] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:32.325263 23942 raft_consensus.cc:482] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:32.326275 24030 leader_election.cc:288] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:32.325578 23942 raft_consensus.cc:3037] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:32.328078 23740 tablet_bootstrap.cc:654] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:32.301470 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:32.332960 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:32.333746 23578 raft_consensus.cc:3037] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:32.333806 23797 raft_consensus.cc:2726] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:32.347764 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:32.327554 23970 consensus_queue.cc:1035] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260807 13:38:32.326121 23899 leader_election.cc:288] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:32.333818 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:32.371889 23479 raft_consensus.cc:2454] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
W20260807 13:38:32.374603 23533 leader_election.cc:341] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:38:32.377148 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 43753.2us
I20260807 13:38:32.334682 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:32.380911 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:32.381565 23684 raft_consensus.cc:2454] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
W20260807 13:38:32.385362 23631 leader_election.cc:341] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:32.389614 23948 consensus_queue.cc:1035] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:32.386565 23582 raft_consensus.cc:3037] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:32.396302 23948 consensus_queue.cc:1035] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:32.402578 23739 tablet_bootstrap.cc:492] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:32.403013 23739 ts_tablet_manager.cc:1397] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.140s user 0.010s sys 0.002s
I20260807 13:38:32.405395 23941 raft_consensus.cc:482] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:32.382951 23581 raft_consensus.cc:2454] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:32.398185 23970 consensus_queue.cc:1035] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260807 13:38:32.409416 23739 raft_consensus.cc:348] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.409999 23739 raft_consensus.cc:374] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:32.410245 23739 raft_consensus.cc:729] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:32.400300 23532 leader_election.cc:302] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:32.410815 23739 consensus_queue.cc:260] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.415575 23969 raft_consensus.cc:2781] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:32.416024 23969 raft_consensus.cc:482] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:32.416359 23969 raft_consensus.cc:3037] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:32.423749 23737 tablet_bootstrap.cc:492] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:32.402266 23429 leader_election.cc:302] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:32.427721 23737 ts_tablet_manager.cc:1397] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.294s user 0.014s sys 0.019s
I20260807 13:38:32.405995 23941 raft_consensus.cc:504] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.423550 23578 raft_consensus.cc:2454] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:32.437961 24030 raft_consensus.cc:482] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:32.442238 24030 raft_consensus.cc:504] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.438341 23970 raft_consensus.cc:2781] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:32.445050 23970 raft_consensus.cc:686] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
W20260807 13:38:32.447192 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 47823.8us
I20260807 13:38:32.447249 23739 ts_tablet_manager.cc:1428] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.044s user 0.003s sys 0.004s
I20260807 13:38:32.452243 24047 raft_consensus.cc:482] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:32.452790 24047 raft_consensus.cc:504] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.453466 23739 tablet_bootstrap.cc:492] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:32.454912 24047 leader_election.cc:288] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:32.445950 23970 consensus_queue.cc:237] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.465138 23633 leader_election.cc:302] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:32.466086 23968 raft_consensus.cc:2781] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:32.466637 23968 raft_consensus.cc:686] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:32.471199 23968 consensus_queue.cc:237] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.473811 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:32.500706 23737 raft_consensus.cc:348] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.501600 23737 raft_consensus.cc:374] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:32.501927 23737 raft_consensus.cc:729] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:32.502642 23737 consensus_queue.cc:260] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.461367 23942 raft_consensus.cc:504] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.505905 24030 leader_election.cc:288] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:32.506114 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:32.507228 23480 raft_consensus.cc:2379] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 1: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:32.516458 23737 ts_tablet_manager.cc:1428] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.086s user 0.008s sys 0.000s
I20260807 13:38:32.518194 23737 tablet_bootstrap.cc:492] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
W20260807 13:38:32.530622 23532 leader_election.cc:341] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:32.522611 23797 raft_consensus.cc:482] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:32.535538 23740 tablet_bootstrap.cc:492] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:32.536111 23740 ts_tablet_manager.cc:1397] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.253s user 0.013s sys 0.010s
I20260807 13:38:32.530905 24047 consensus_queue.cc:1035] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:38:32.529484 23941 leader_election.cc:288] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:32.535974 23478 raft_consensus.cc:3037] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:32.548192 23899 consensus_queue.cc:1035] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:32.533275 23969 raft_consensus.cc:504] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.533488 23797 raft_consensus.cc:504] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.561777 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:32.544559 23533 leader_election.cc:341] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:32.562736 23533 leader_election.cc:302] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:32.572232 23862 raft_consensus.cc:2726] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:32.577397 23739 tablet_bootstrap.cc:654] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:32.578994 23797 leader_election.cc:288] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:32.579821 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:32.586030 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:32.586355 23969 leader_election.cc:288] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:32.587468 23481 raft_consensus.cc:2379] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 2: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:32.580089 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:32.606405 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:32.606490 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:32.609004 23684 raft_consensus.cc:2454] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:32.606982 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:32.615571 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:32.616372 23479 raft_consensus.cc:2454] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:32.583413 23941 raft_consensus.cc:482] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:32.617866 23941 raft_consensus.cc:504] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.621731 23429 leader_election.cc:302] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:32.577019 23578 raft_consensus.cc:2454] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:32.624724 23533 leader_election.cc:302] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:32.627542 23797 raft_consensus.cc:2781] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:32.624797 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:32.628129 23797 raft_consensus.cc:482] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:32.628610 23797 raft_consensus.cc:3037] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:32.629000 23679 raft_consensus.cc:2379] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 1: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:32.631544 23941 leader_election.cc:288] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:32.617817 23737 tablet_bootstrap.cc:654] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:32.635452 23968 raft_consensus.cc:482] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:32.636117 23968 raft_consensus.cc:504] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.582402 23942 leader_election.cc:288] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:32.641429 23968 leader_election.cc:288] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:32.641415 23582 raft_consensus.cc:2454] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:32.651374 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:32.653417 23533 leader_election.cc:341] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:32.659019 23633 leader_election.cc:302] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:32.665709 23899 raft_consensus.cc:2781] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:32.666291 23899 raft_consensus.cc:686] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:32.667256 23899 consensus_queue.cc:237] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.667099 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:32.683465 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:32.684073 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:32.684258 23582 raft_consensus.cc:2454] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
W20260807 13:38:32.686780 24057 log.cc:924] Time spent T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.089s user 0.000s sys 0.000s
W20260807 13:38:32.687703 24059 log.cc:924] Time spent T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.087s user 0.001s sys 0.000s
I20260807 13:38:32.685755 23797 raft_consensus.cc:504] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.692299 23429 leader_election.cc:302] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
W20260807 13:38:32.693002 23532 consensus_peers.cc:487] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 -> Peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Couldn't send request to peer e11cad1eeaf5424c94e51241096f6613. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260807 13:38:32.693652 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 114457us
I20260807 13:38:32.693924 23797 leader_election.cc:288] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:32.693801 23429 leader_election.cc:341] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:32.697207 23740 raft_consensus.cc:348] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.698205 24051 raft_consensus.cc:2726] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:32.698302 23631 leader_election.cc:302] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:32.701538 23901 raft_consensus.cc:2726] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:32.699110 23740 raft_consensus.cc:374] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:32.712452 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:32.713559 23480 raft_consensus.cc:3037] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:32.716775 23633 leader_election.cc:302] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:32.718613 23968 raft_consensus.cc:2781] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:32.718128 23737 tablet_bootstrap.cc:492] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:32.696739 23941 raft_consensus.cc:2726] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:38:32.719316 23968 raft_consensus.cc:482] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:32.719843 23968 raft_consensus.cc:3037] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:32.721601 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:32.722332 23479 raft_consensus.cc:3037] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:32.728633 23430 leader_election.cc:302] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:32.730155 23941 raft_consensus.cc:2781] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:32.731143 23941 raft_consensus.cc:482] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:32.731668 23941 raft_consensus.cc:3037] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:32.739686 23740 raft_consensus.cc:729] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:32.740805 23740 consensus_queue.cc:260] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.744769 23479 raft_consensus.cc:2454] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:32.756492 24061 raft_consensus.cc:482] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:32.757254 24061 raft_consensus.cc:504] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.761857 23740 ts_tablet_manager.cc:1428] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.225s user 0.008s sys 0.000s
I20260807 13:38:32.767838 23737 ts_tablet_manager.cc:1397] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.250s user 0.024s sys 0.026s
I20260807 13:38:32.768244 23740 tablet_bootstrap.cc:492] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:32.769702 23739 tablet_bootstrap.cc:492] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:32.770172 23739 ts_tablet_manager.cc:1397] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.317s user 0.017s sys 0.005s
I20260807 13:38:32.771236 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:32.772161 23532 leader_election.cc:302] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
W20260807 13:38:32.776171 23407 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:38:32.776794 23797 raft_consensus.cc:2781] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:32.777361 23797 raft_consensus.cc:686] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:32.779253 23739 raft_consensus.cc:348] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.783666 23739 raft_consensus.cc:374] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:32.784245 23739 raft_consensus.cc:729] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:32.784969 23739 consensus_queue.cc:260] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.784888 23797 consensus_queue.cc:237] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.787963 23739 ts_tablet_manager.cc:1428] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.018s user 0.008s sys 0.000s
I20260807 13:38:32.789080 23739 tablet_bootstrap.cc:492] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:32.777089 24067 consensus_queue.cc:1035] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260807 13:38:32.791563 23345 catalog_manager.cc:5495] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 0 to 1, leader changed from <none> to e11cad1eeaf5424c94e51241096f6613 (127.21.69.1). New cstate: current_term: 1 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:32.793865 24061 leader_election.cc:288] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:32.796641 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:32.802809 23532 leader_election.cc:341] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:32.810750 23480 raft_consensus.cc:2454] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:32.812551 23532 leader_election.cc:302] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:32.816308 23796 raft_consensus.cc:2781] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:32.816951 23796 raft_consensus.cc:686] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:32.817924 23796 consensus_queue.cc:237] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.821805 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:32.822417 23679 raft_consensus.cc:3037] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:32.829656 23737 raft_consensus.cc:348] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.833644 23739 tablet_bootstrap.cc:654] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:32.833781 23737 raft_consensus.cc:374] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:32.834237 23737 raft_consensus.cc:729] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:32.835300 23740 tablet_bootstrap.cc:654] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
W20260807 13:38:32.829783 24050 log.cc:924] Time spent T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.051s user 0.000s sys 0.011s
W20260807 13:38:32.829031 23533 leader_election.cc:341] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:32.837929 23533 leader_election.cc:302] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:32.838819 23737 consensus_queue.cc:260] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.839836 24047 raft_consensus.cc:2726] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:32.849582 23737 ts_tablet_manager.cc:1428] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.081s user 0.006s sys 0.001s
I20260807 13:38:32.850466 23941 raft_consensus.cc:504] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:32.857604 23631 consensus_peers.cc:487] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a -> Peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Couldn't send request to peer e11cad1eeaf5424c94e51241096f6613. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:38:32.858635 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
W20260807 13:38:32.860355 23429 leader_election.cc:341] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:32.861153 23941 leader_election.cc:288] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:32.859886 23344 catalog_manager.cc:5495] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3). New cstate: current_term: 1 leader_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: HEALTHY } } }
I20260807 13:38:32.866770 23968 raft_consensus.cc:504] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.871063 23684 raft_consensus.cc:3037] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:32.870244 23739 tablet_bootstrap.cc:492] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:32.875219 23739 ts_tablet_manager.cc:1397] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.086s user 0.011s sys 0.004s
I20260807 13:38:32.877342 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:32.877710 23737 tablet_bootstrap.cc:492] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:32.878082 23578 raft_consensus.cc:3037] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:32.885105 23737 tablet_bootstrap.cc:654] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:32.886147 23739 raft_consensus.cc:348] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.886961 23739 raft_consensus.cc:374] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:32.887246 23739 raft_consensus.cc:729] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:32.889833 23941 consensus_queue.cc:1035] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:38:32.892063 23739 consensus_queue.cc:260] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.896216 23739 ts_tablet_manager.cc:1428] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.021s user 0.007s sys 0.000s
I20260807 13:38:32.902998 23739 tablet_bootstrap.cc:492] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:32.909549 23737 tablet_bootstrap.cc:492] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:32.909252 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:32.910104 23737 ts_tablet_manager.cc:1397] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.033s user 0.012s sys 0.008s
I20260807 13:38:32.869408 23344 catalog_manager.cc:5495] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3). New cstate: current_term: 1 leader_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: HEALTHY } } }
I20260807 13:38:32.910964 23479 raft_consensus.cc:2354] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3.
I20260807 13:38:32.913251 23631 leader_election.cc:398] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Vote denied by peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037) with higher term. Message: Invalid argument: T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3.
I20260807 13:38:32.913713 23631 leader_election.cc:401] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 13:38:32.916920 23578 raft_consensus.cc:2454] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:32.909335 23684 raft_consensus.cc:2454] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:32.919385 23968 leader_election.cc:288] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:32.919329 23737 raft_consensus.cc:348] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.920303 23737 raft_consensus.cc:374] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:32.920529 23737 raft_consensus.cc:729] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:32.921250 23739 tablet_bootstrap.cc:654] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:32.921403 23737 consensus_queue.cc:260] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.923100 23430 leader_election.cc:302] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:32.924479 23942 raft_consensus.cc:2781] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:32.924916 24069 raft_consensus.cc:2726] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037) with higher term. Message: Invalid argument: T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3.
I20260807 13:38:32.925064 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:32.925308 23942 raft_consensus.cc:686] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:32.926306 23942 consensus_queue.cc:237] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.934149 23737 ts_tablet_manager.cc:1428] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.024s user 0.007s sys 0.000s
I20260807 13:38:32.935343 23737 tablet_bootstrap.cc:492] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:32.945632 23740 tablet_bootstrap.cc:492] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:32.946182 23740 ts_tablet_manager.cc:1397] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.178s user 0.022s sys 0.027s
I20260807 13:38:32.946018 23970 consensus_queue.cc:1035] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:32.958060 24069 consensus_queue.cc:1035] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:32.966372 23740 raft_consensus.cc:348] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.967316 23740 raft_consensus.cc:374] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:32.967682 23740 raft_consensus.cc:729] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:32.970171 23342 catalog_manager.cc:5495] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:32.968403 23740 consensus_queue.cc:260] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:32.979389 23740 ts_tablet_manager.cc:1428] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.033s user 0.009s sys 0.001s
I20260807 13:38:32.997834 23737 tablet_bootstrap.cc:654] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:33.005365 23739 tablet_bootstrap.cc:492] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:33.005877 23739 ts_tablet_manager.cc:1397] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.103s user 0.021s sys 0.024s
I20260807 13:38:33.008399 23739 raft_consensus.cc:348] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.009114 23739 raft_consensus.cc:374] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:33.009368 23739 raft_consensus.cc:729] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:33.010087 23796 raft_consensus.cc:482] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:33.010532 23739 consensus_queue.cc:260] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.010804 23796 raft_consensus.cc:504] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.013175 23739 ts_tablet_manager.cc:1428] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260807 13:38:33.018246 23739 tablet_bootstrap.cc:492] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:33.019040 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:33.024526 23739 tablet_bootstrap.cc:654] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
W20260807 13:38:33.024856 23532 leader_election.cc:341] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:33.029345 23740 tablet_bootstrap.cc:492] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:33.031203 23796 leader_election.cc:288] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:33.032346 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:33.034590 23533 leader_election.cc:341] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:33.035079 23533 leader_election.cc:302] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:33.036401 23739 tablet_bootstrap.cc:492] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:33.036303 23796 raft_consensus.cc:2726] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:33.036954 23739 ts_tablet_manager.cc:1397] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.023s user 0.013s sys 0.004s
I20260807 13:38:33.039606 23739 raft_consensus.cc:348] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.040464 23739 raft_consensus.cc:374] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:33.040805 23739 raft_consensus.cc:729] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:33.040192 23346 catalog_manager.cc:5495] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 0 to 1, leader changed from <none> to e11cad1eeaf5424c94e51241096f6613 (127.21.69.1). New cstate: current_term: 1 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:33.041437 23739 consensus_queue.cc:260] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.048287 23739 ts_tablet_manager.cc:1428] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.011s user 0.003s sys 0.004s
I20260807 13:38:33.049216 23739 tablet_bootstrap.cc:492] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:33.054946 23739 tablet_bootstrap.cc:654] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:33.066814 23739 tablet_bootstrap.cc:492] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:33.067354 23739 ts_tablet_manager.cc:1397] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.009s
I20260807 13:38:33.070077 23739 raft_consensus.cc:348] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.070770 23739 raft_consensus.cc:374] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:33.071040 23739 raft_consensus.cc:729] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:33.071612 23739 consensus_queue.cc:260] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.078737 23739 ts_tablet_manager.cc:1428] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.011s user 0.003s sys 0.003s
I20260807 13:38:33.079962 23739 tablet_bootstrap.cc:492] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:33.080315 23342 catalog_manager.cc:5495] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2). New cstate: current_term: 1 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:33.085983 23739 tablet_bootstrap.cc:654] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:33.105453 23942 raft_consensus.cc:482] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:33.106043 23942 raft_consensus.cc:504] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.113533 24071 raft_consensus.cc:482] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:33.114130 24071 raft_consensus.cc:504] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.115274 23737 tablet_bootstrap.cc:492] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:33.115863 23737 ts_tablet_manager.cc:1397] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.181s user 0.043s sys 0.036s
I20260807 13:38:33.116379 23479 raft_consensus.cc:3037] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:33.120024 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:33.122510 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:33.123245 24071 leader_election.cc:288] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:33.111974 23942 leader_election.cc:288] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:33.124662 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:33.125546 23480 raft_consensus.cc:2379] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 1: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
W20260807 13:38:33.132683 23429 leader_election.cc:341] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:33.133482 23968 consensus_queue.cc:1035] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:38:33.135197 23740 tablet_bootstrap.cc:654] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:33.137598 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:33.145323 23633 leader_election.cc:302] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:33.146607 24067 raft_consensus.cc:3037] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:33.123288 23577 raft_consensus.cc:2454] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:38:33.159233 23430 leader_election.cc:302] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:33.167922 24051 raft_consensus.cc:482] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:33.160825 23942 raft_consensus.cc:2781] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:33.172237 24051 raft_consensus.cc:504] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.174887 23737 raft_consensus.cc:348] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.175676 23737 raft_consensus.cc:374] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:33.176014 23737 raft_consensus.cc:729] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:33.176750 23737 consensus_queue.cc:260] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.174360 23942 raft_consensus.cc:482] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:33.177688 23942 raft_consensus.cc:3037] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:33.178854 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:33.178962 24051 leader_election.cc:288] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:33.180189 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:33.183048 23739 tablet_bootstrap.cc:492] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:33.183557 23739 ts_tablet_manager.cc:1397] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.104s user 0.030s sys 0.043s
I20260807 13:38:33.183889 23430 leader_election.cc:302] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:33.184592 24067 raft_consensus.cc:2726] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:33.185070 24051 raft_consensus.cc:2726] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:33.191598 23968 consensus_queue.cc:1035] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:33.195390 23739 raft_consensus.cc:348] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.196190 23739 raft_consensus.cc:374] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:33.196460 23739 raft_consensus.cc:729] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:33.197141 23739 consensus_queue.cc:260] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.199957 23739 ts_tablet_manager.cc:1428] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20260807 13:38:33.201119 23739 tablet_bootstrap.cc:492] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:33.205896 23737 ts_tablet_manager.cc:1428] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.090s user 0.007s sys 0.000s
I20260807 13:38:33.207005 23737 tablet_bootstrap.cc:492] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:33.219753 24071 raft_consensus.cc:482] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:33.220325 24071 raft_consensus.cc:504] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.227496 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:33.229220 23740 tablet_bootstrap.cc:492] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:33.229720 23740 ts_tablet_manager.cc:1397] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.201s user 0.011s sys 0.019s
I20260807 13:38:33.228304 23739 tablet_bootstrap.cc:654] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:33.233804 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:33.233881 23942 raft_consensus.cc:504] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.234880 23580 raft_consensus.cc:2379] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 1: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:33.236884 23633 leader_election.cc:302] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:33.237845 24067 raft_consensus.cc:3037] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:33.241205 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
W20260807 13:38:33.244346 23429 leader_election.cc:341] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:33.244768 23740 raft_consensus.cc:348] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.245433 23737 tablet_bootstrap.cc:654] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:33.245517 23740 raft_consensus.cc:374] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:33.245931 23740 raft_consensus.cc:729] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:33.246577 23740 consensus_queue.cc:260] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.242190 24071 leader_election.cc:288] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:33.252210 23740 ts_tablet_manager.cc:1428] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.022s user 0.006s sys 0.001s
I20260807 13:38:33.253026 23740 tablet_bootstrap.cc:492] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:33.245370 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:33.256206 23580 raft_consensus.cc:3037] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:33.237576 23942 leader_election.cc:288] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:33.265372 24067 raft_consensus.cc:2726] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:33.266201 23942 raft_consensus.cc:482] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:33.267441 23942 raft_consensus.cc:504] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.271660 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:33.271783 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:33.271792 23942 leader_election.cc:288] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:33.272460 23577 raft_consensus.cc:2454] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
W20260807 13:38:33.274914 23429 leader_election.cc:341] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:33.276512 23430 leader_election.cc:302] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:33.278925 23480 raft_consensus.cc:1261] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:33.278990 23479 raft_consensus.cc:3037] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:33.283684 23797 consensus_queue.cc:1035] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.003s
I20260807 13:38:33.284497 23740 tablet_bootstrap.cc:654] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:33.285343 23942 raft_consensus.cc:2781] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:33.287680 23942 raft_consensus.cc:482] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:33.299500 23942 raft_consensus.cc:3037] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:33.320765 23580 raft_consensus.cc:2454] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:33.322947 23430 leader_election.cc:302] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:33.323907 24051 raft_consensus.cc:2781] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:33.324450 24051 raft_consensus.cc:686] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:33.325357 24051 consensus_queue.cc:237] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.338328 23739 tablet_bootstrap.cc:492] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:33.339061 23737 tablet_bootstrap.cc:492] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:33.339249 23739 ts_tablet_manager.cc:1397] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.138s user 0.020s sys 0.043s
I20260807 13:38:33.339564 23737 ts_tablet_manager.cc:1397] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.133s user 0.014s sys 0.005s
I20260807 13:38:33.340586 23942 raft_consensus.cc:504] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.342195 23737 raft_consensus.cc:348] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.342692 23942 leader_election.cc:288] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:33.342983 23737 raft_consensus.cc:374] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:33.343307 23737 raft_consensus.cc:729] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:33.344120 23737 consensus_queue.cc:260] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.344589 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:33.344192 23739 raft_consensus.cc:348] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.345432 23739 raft_consensus.cc:374] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260807 13:38:33.346158 23429 leader_election.cc:341] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:33.348217 23739 raft_consensus.cc:729] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:33.349167 23739 consensus_queue.cc:260] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.352545 24047 raft_consensus.cc:482] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:33.353111 24047 raft_consensus.cc:504] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.353622 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:33.354209 23580 raft_consensus.cc:3037] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:33.355211 24047 leader_election.cc:288] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:33.357218 23679 raft_consensus.cc:1261] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:33.357084 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:33.357815 23684 raft_consensus.cc:2454] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:33.359156 24054 raft_consensus.cc:482] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:33.359361 23533 leader_election.cc:302] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:33.359707 24054 raft_consensus.cc:504] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.360237 24047 raft_consensus.cc:2781] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:33.360268 23739 ts_tablet_manager.cc:1428] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.021s user 0.007s sys 0.000s
I20260807 13:38:33.360663 24047 raft_consensus.cc:482] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:33.370988 24047 raft_consensus.cc:3037] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:33.371795 23739 tablet_bootstrap.cc:492] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:33.361995 23580 raft_consensus.cc:2454] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:33.352918 23737 ts_tablet_manager.cc:1428] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20260807 13:38:33.373512 23737 tablet_bootstrap.cc:492] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:33.374678 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:33.375396 23577 raft_consensus.cc:2454] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:38:33.371443 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:33.364167 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:33.362124 24054 leader_election.cc:288] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:33.379299 23429 leader_election.cc:341] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:33.380836 23737 tablet_bootstrap.cc:654] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:33.380053 24047 raft_consensus.cc:504] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.382854 23739 tablet_bootstrap.cc:654] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:33.382876 23430 leader_election.cc:302] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:33.385205 23430 leader_election.cc:302] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:33.386380 24054 raft_consensus.cc:2781] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:33.391047 23797 consensus_queue.cc:1035] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:33.428160 24054 raft_consensus.cc:686] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:33.398649 24047 leader_election.cc:288] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:33.404853 23737 tablet_bootstrap.cc:492] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:33.429839 23737 ts_tablet_manager.cc:1397] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.057s user 0.008s sys 0.006s
I20260807 13:38:33.429451 24054 consensus_queue.cc:237] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.405722 23970 raft_consensus.cc:482] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:33.432695 23737 raft_consensus.cc:348] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.433485 23737 raft_consensus.cc:374] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:33.432866 23970 raft_consensus.cc:504] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.433766 23737 raft_consensus.cc:729] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:33.434451 23737 consensus_queue.cc:260] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.435463 23970 leader_election.cc:288] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:33.437357 23737 ts_tablet_manager.cc:1428] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
W20260807 13:38:33.449436 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 64357.9us
W20260807 13:38:33.450519 23532 leader_election.cc:341] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:33.453202 23970 raft_consensus.cc:2781] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:33.453794 23970 raft_consensus.cc:482] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:33.454269 23970 raft_consensus.cc:3037] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:33.455899 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:33.456935 23577 raft_consensus.cc:2454] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:38:33.481571 24071 raft_consensus.cc:482] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:33.482170 24071 raft_consensus.cc:504] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.483016 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:33.484349 24071 leader_election.cc:288] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:33.486178 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:33.486982 23577 raft_consensus.cc:2454] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 0.
I20260807 13:38:33.475207 23970 raft_consensus.cc:504] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.484314 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:33.488528 23633 leader_election.cc:302] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:33.483960 23679 raft_consensus.cc:3037] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:33.489547 23970 leader_election.cc:288] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:33.491467 23796 consensus_queue.cc:1035] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:33.494123 24071 raft_consensus.cc:2781] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:33.494648 24071 raft_consensus.cc:482] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:33.495110 24071 raft_consensus.cc:3037] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:38:33.503820 23429 leader_election.cc:341] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:33.503945 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:33.516595 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
W20260807 13:38:33.517385 23631 leader_election.cc:341] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:38:33.519223 23429 leader_election.cc:341] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:33.531913 23740 tablet_bootstrap.cc:492] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:33.532614 23740 ts_tablet_manager.cc:1397] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.280s user 0.031s sys 0.019s
I20260807 13:38:33.539815 23737 tablet_bootstrap.cc:492] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:33.568572 23740 raft_consensus.cc:348] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.553049 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:33.569398 23740 raft_consensus.cc:374] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:33.570755 23797 consensus_queue.cc:1035] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260807 13:38:33.573086 23970 consensus_queue.cc:1035] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260807 13:38:33.588838 23679 raft_consensus.cc:2454] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:33.591459 23430 leader_election.cc:302] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:33.592595 23737 tablet_bootstrap.cc:654] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:33.593673 23740 raft_consensus.cc:729] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
W20260807 13:38:33.596549 23532 leader_election.cc:341] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:33.595417 23740 consensus_queue.cc:260] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.597551 23533 leader_election.cc:302] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:33.594838 23942 raft_consensus.cc:2781] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:33.603921 23797 raft_consensus.cc:2781] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:33.604367 23797 raft_consensus.cc:686] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:33.605014 23797 consensus_queue.cc:237] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.608402 23739 tablet_bootstrap.cc:492] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:33.599480 23942 raft_consensus.cc:482] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:33.609076 23739 ts_tablet_manager.cc:1397] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.238s user 0.074s sys 0.090s
I20260807 13:38:33.611907 23942 raft_consensus.cc:3037] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:33.641139 23740 ts_tablet_manager.cc:1428] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.108s user 0.005s sys 0.008s
I20260807 13:38:33.646697 23739 raft_consensus.cc:348] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.654548 24071 raft_consensus.cc:504] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.656832 24071 leader_election.cc:288] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:33.660516 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:33.661274 23580 raft_consensus.cc:3037] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:33.661489 23740 tablet_bootstrap.cc:492] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:33.637296 23968 raft_consensus.cc:482] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:33.667173 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:33.668159 23577 raft_consensus.cc:3037] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:33.647562 23739 raft_consensus.cc:374] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:33.672119 23739 raft_consensus.cc:729] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:33.672955 23739 consensus_queue.cc:260] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.673149 23968 raft_consensus.cc:504] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:33.688622 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 85320.2us
I20260807 13:38:33.706667 23739 ts_tablet_manager.cc:1428] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.096s user 0.007s sys 0.001s
I20260807 13:38:33.708271 23739 tablet_bootstrap.cc:492] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:33.739269 23342 catalog_manager.cc:5495] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2). New cstate: current_term: 1 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:33.756884 23968 leader_election.cc:288] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:33.764906 23737 tablet_bootstrap.cc:492] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:33.765455 23737 ts_tablet_manager.cc:1397] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.226s user 0.017s sys 0.026s
I20260807 13:38:33.765637 23740 tablet_bootstrap.cc:654] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:33.772585 23737 raft_consensus.cc:348] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.773710 23737 raft_consensus.cc:374] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:33.782063 23737 raft_consensus.cc:729] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:33.783061 23737 consensus_queue.cc:260] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.802026 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:33.802919 24119 consensus_queue.cc:1035] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260807 13:38:33.802915 23582 raft_consensus.cc:2454] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 0.
I20260807 13:38:33.834264 23737 ts_tablet_manager.cc:1428] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.069s user 0.007s sys 0.001s
I20260807 13:38:33.835574 23737 tablet_bootstrap.cc:492] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:33.836827 23970 raft_consensus.cc:482] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:33.857019 23633 leader_election.cc:302] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:33.846640 23942 raft_consensus.cc:504] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.868515 23739 tablet_bootstrap.cc:654] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:33.875777 23346 catalog_manager.cc:5495] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 0 to 1, leader changed from <none> to e11cad1eeaf5424c94e51241096f6613 (127.21.69.1). New cstate: current_term: 1 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:33.879439 23346 catalog_manager.cc:5495] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 0 to 1, leader changed from <none> to e11cad1eeaf5424c94e51241096f6613 (127.21.69.1). New cstate: current_term: 1 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:33.858501 23970 raft_consensus.cc:504] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:33.905293 23580 raft_consensus.cc:2454] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:33.909229 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:33.910166 23578 raft_consensus.cc:3037] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:33.871393 23942 leader_election.cc:288] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:33.877890 23899 raft_consensus.cc:2781] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:33.918478 23430 leader_election.cc:302] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:33.924088 23740 tablet_bootstrap.cc:492] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:33.924615 23740 ts_tablet_manager.cc:1397] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.263s user 0.016s sys 0.016s
I20260807 13:38:33.929196 23970 leader_election.cc:288] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:33.919112 23899 raft_consensus.cc:482] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:33.930397 23899 raft_consensus.cc:3037] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:33.925980 23942 raft_consensus.cc:2781] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:33.944145 23968 raft_consensus.cc:482] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:33.963259 23578 raft_consensus.cc:2454] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:33.966992 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:33.965523 23942 raft_consensus.cc:686] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:33.947539 23968 raft_consensus.cc:504] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:34.212339 24133 log.cc:924] Time spent T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.295s user 0.000s sys 0.000s
I20260807 13:38:34.221325 23968 leader_election.cc:288] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
W20260807 13:38:34.224936 23577 consensus_meta.cc:287] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.556s user 0.014s sys 0.000s
W20260807 13:38:34.170051 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 222814us
I20260807 13:38:34.309306 23577 raft_consensus.cc:2454] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:34.526185 23739 tablet_bootstrap.cc:492] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:34.526963 23739 ts_tablet_manager.cc:1397] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.819s user 0.023s sys 0.026s
I20260807 13:38:34.534463 23739 raft_consensus.cc:348] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:34.535553 23739 raft_consensus.cc:374] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:34.535962 23739 raft_consensus.cc:729] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:34.536823 23739 consensus_queue.cc:260] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:34.517647 24067 raft_consensus.cc:482] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:34.539633 24067 raft_consensus.cc:504] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:34.542392 24067 leader_election.cc:288] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:34.618465 23740 raft_consensus.cc:348] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:34.619540 23740 raft_consensus.cc:374] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:34.619957 23740 raft_consensus.cc:729] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:34.620785 23740 consensus_queue.cc:260] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:34.398633 23942 consensus_queue.cc:237] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:34.863698 23739 ts_tablet_manager.cc:1428] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.336s user 0.007s sys 0.000s
I20260807 13:38:34.865156 23739 tablet_bootstrap.cc:492] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:34.870402 23737 tablet_bootstrap.cc:654] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:34.872732 23739 tablet_bootstrap.cc:654] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
W20260807 13:38:34.879704 23430 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.960s user 0.021s sys 0.017s
W20260807 13:38:34.880231 23430 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.961s user 0.024s sys 0.017s
W20260807 13:38:34.880941 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 962480us
I20260807 13:38:34.893621 23740 ts_tablet_manager.cc:1428] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.969s user 0.008s sys 0.001s
W20260807 13:38:34.894157 23740 ts_tablet_manager.cc:1460] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1: Tablet startup took 969ms
W20260807 13:38:34.631613 23899 consensus_meta.cc:287] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.701s user 0.007s sys 0.002s
W20260807 13:38:34.894521 23740 ts_tablet_manager.cc:1462] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1: Trace:
0807 13:38:28.306308 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:28.306470 (+ 162us) service_pool.cc:227] Handling call
0807 13:38:28.336425 (+ 29955us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:38:28.336562 (+ 137us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:38:28.448875 (+112313us) tablet_metadata.cc:641] Metadata flushed
0807 13:38:28.483662 (+ 34787us) tablet_replica.cc:205] Creating consensus instance
0807 13:38:28.558462 (+ 74800us) inbound_call.cc:173] Queueing success response
0807 13:38:33.661066 (+5102604us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0807 13:38:33.924896 (+263830us) ts_tablet_manager.cc:1429] Starting tablet replica
0807 13:38:34.528470 (+603574us) tablet_replica.cc:259] Starting instrumentation
0807 13:38:34.532660 (+ 4190us) tablet_replica.cc:278] Starting consensus
Metrics: {"mutex_wait_us":63214,"raft.queue_time_us":271540,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":4402,"tablet-open.queue_time_us":5135573}
I20260807 13:38:34.914023 23740 tablet_bootstrap.cc:492] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:34.912403 23899 raft_consensus.cc:504] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:34.932564 23739 tablet_bootstrap.cc:492] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:34.933197 23899 leader_election.cc:288] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:34.933328 23739 ts_tablet_manager.cc:1397] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.068s user 0.024s sys 0.009s
I20260807 13:38:34.943466 23342 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41376 (request call id 62) took 1220 ms. Trace:
I20260807 13:38:34.949572 23739 raft_consensus.cc:348] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:34.950675 23739 raft_consensus.cc:374] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:34.951020 23739 raft_consensus.cc:729] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:34.953958 23739 consensus_queue.cc:260] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:34.957377 23739 ts_tablet_manager.cc:1428] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.017s user 0.005s sys 0.003s
I20260807 13:38:34.958853 23739 tablet_bootstrap.cc:492] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:34.964831 24158 raft_consensus.cc:482] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:34.965792 24158 raft_consensus.cc:504] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:34.966603 23430 leader_election.cc:302] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:34.968041 24158 leader_election.cc:288] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:34.968657 24158 consensus_queue.cc:1035] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:38:34.970686 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 74) took 1006 ms. Trace:
I20260807 13:38:34.971031 24158 raft_consensus.cc:2781] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:34.971550 24158 raft_consensus.cc:686] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:34.978129 24158 consensus_queue.cc:237] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:34.971169 23481 rpcz_store.cc:276] 0807 13:38:33.964410 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:34.969734 (+1005324us) service_pool.cc:227] Handling call
0807 13:38:34.970125 (+ 391us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:34.970331 (+ 206us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:34.970363 (+ 32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:34.970406 (+ 43us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:34.970445 (+ 39us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:34.970504 (+ 59us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:34.970623 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:35.107316 23740 tablet_bootstrap.cc:654] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:34.971236 23942 raft_consensus.cc:482] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:35.107972 23942 raft_consensus.cc:504] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:35.110291 23942 leader_election.cc:288] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:34.944382 23342 rpcz_store.cc:276] 0807 13:38:33.723082 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:33.725586 (+ 2504us) service_pool.cc:227] Handling call
0807 13:38:34.943355 (+1217769us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:38:33.862025 (+ 0us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b44000232cc. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc695049a95 00007fc69504a4b2 00007fc697cf2511 00007fc697cede1a 00007fc6951195fe 00007fc69df50a39 00007fc6951368bb 00007fc695134cbf 00007fc695134155 00007fc69ba6d714
0807 13:38:33.927983 (+ 65958us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:38:33.947265 (+ 19282us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:38:33.947299 (+ 34us) write_op.cc:435] Acquired schema lock
0807 13:38:33.947317 (+ 18us) tablet.cc:660] Decoding operations
0807 13:38:33.947662 (+ 345us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:38:33.947720 (+ 58us) write_op.cc:641] Partition lock acquired for write op
0807 13:38:33.947747 (+ 27us) tablet.cc:683] Acquiring locks for 1 operations
0807 13:38:33.947954 (+ 207us) tablet.cc:699] Row locks acquired
0807 13:38:33.947976 (+ 22us) write_op.cc:260] PREPARE: finished
0807 13:38:33.948113 (+ 137us) write_op.cc:270] Start()
0807 13:38:33.948315 (+ 202us) write_op.cc:276] Timestamp: P: 1786109913948076 usec, L: 0
0807 13:38:33.948338 (+ 23us) op_driver.cc:331] REPLICATION: starting
0807 13:38:33.948989 (+ 651us) log.cc:842] Serialized 534 byte log entry
0807 13:38:34.538609 (+589620us) op_driver.cc:444] REPLICATION: finished
0807 13:38:34.936727 (+398118us) write_op.cc:301] APPLY: starting
0807 13:38:34.936817 (+ 90us) tablet.cc:1365] starting BulkCheckPresence
0807 13:38:34.936927 (+ 110us) tablet.cc:1368] finished BulkCheckPresence
0807 13:38:34.936949 (+ 22us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:38:34.937195 (+ 246us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:38:34.937374 (+ 179us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 13:38:34.937421 (+ 47us) write_op.cc:312] APPLY: finished
0807 13:38:34.937653 (+ 232us) log.cc:842] Serialized 22 byte log entry
0807 13:38:34.937829 (+ 176us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:38:34.937920 (+ 91us) write_op.cc:454] Released schema lock
0807 13:38:34.937956 (+ 36us) write_op.cc:341] FINISH: Updating metrics
0807 13:38:34.938230 (+ 274us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:38:34.938258 (+ 28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":397802,"apply.run_cpu_time_us":1781,"apply.run_wall_time_us":1783,"num_ops":1,"prepare.queue_time_us":167281,"prepare.run_cpu_time_us":2839,"prepare.run_wall_time_us":29484,"replication_time_us":590085,"spinlock_wait_cycles":4735232,"thread_start_us":550499,"threads_started":2}]]}
I20260807 13:38:35.127952 23899 raft_consensus.cc:482] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:35.165125 23899 raft_consensus.cc:504] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:35.168929 23899 leader_election.cc:288] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:35.169796 23899 raft_consensus.cc:482] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:35.170552 23899 raft_consensus.cc:504] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:35.173483 23899 leader_election.cc:288] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:35.163986 24151 raft_consensus.cc:482] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:35.180141 24151 raft_consensus.cc:504] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:35.182997 24151 leader_election.cc:288] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:34.201095 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:35.184777 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 73) took 1220 ms. Trace:
I20260807 13:38:35.185249 23480 rpcz_store.cc:276] 0807 13:38:33.964057 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:33.978027 (+ 13970us) service_pool.cc:227] Handling call
0807 13:38:35.184686 (+1206659us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:38:35.429435 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 88560.6us
I20260807 13:38:35.431046 24176 raft_consensus.cc:482] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:35.431806 24176 raft_consensus.cc:504] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:35.381145 24159 raft_consensus.cc:482] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:35.115726 23739 tablet_bootstrap.cc:700] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613: Time spent opening tablet: real 0.106s user 0.003s sys 0.000s
I20260807 13:38:35.411507 23899 raft_consensus.cc:482] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:35.456071 23739 tablet_bootstrap.cc:654] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
W20260807 13:38:35.455946 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 489374us
I20260807 13:38:35.428227 24161 raft_consensus.cc:482] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:35.447664 24158 raft_consensus.cc:482] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:35.466636 24162 raft_consensus.cc:482] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:35.480020 24174 raft_consensus.cc:482] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:35.480527 24176 leader_election.cc:288] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:35.480146 24162 raft_consensus.cc:504] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:35.480582 24174 raft_consensus.cc:504] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:35.458083 23899 raft_consensus.cc:504] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:35.487917 23737 tablet_bootstrap.cc:492] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:35.488517 23737 ts_tablet_manager.cc:1397] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 1.653s user 0.077s sys 0.089s
I20260807 13:38:35.491101 24174 leader_election.cc:288] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:35.491547 23899 leader_election.cc:288] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:35.455257 24159 raft_consensus.cc:504] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:35.492141 23899 raft_consensus.cc:482] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:35.492667 23899 raft_consensus.cc:504] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:35.493387 24071 raft_consensus.cc:482] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:35.465881 24161 raft_consensus.cc:504] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:35.493882 24071 raft_consensus.cc:504] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:35.494622 23899 leader_election.cc:288] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:35.476744 24158 raft_consensus.cc:504] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:35.496846 24162 leader_election.cc:288] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:35.497046 24172 raft_consensus.cc:482] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:35.497635 24158 leader_election.cc:288] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:35.497605 24172 raft_consensus.cc:504] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:35.510630 23737 raft_consensus.cc:348] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:35.511770 23737 raft_consensus.cc:374] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:35.512132 23737 raft_consensus.cc:729] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:35.513046 23737 consensus_queue.cc:260] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:35.515020 24071 leader_election.cc:288] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:35.515201 24172 leader_election.cc:288] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:35.515688 24161 leader_election.cc:288] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:35.493901 24159 leader_election.cc:288] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:35.500567 24174 raft_consensus.cc:482] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:35.517925 24174 raft_consensus.cc:504] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:35.519555 23737 ts_tablet_manager.cc:1428] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.031s user 0.008s sys 0.001s
I20260807 13:38:35.521138 23737 tablet_bootstrap.cc:492] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:35.526511 23740 tablet_bootstrap.cc:492] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:35.527251 23740 ts_tablet_manager.cc:1397] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.613s user 0.020s sys 0.006s
I20260807 13:38:35.538110 23740 raft_consensus.cc:348] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:35.540606 24174 leader_election.cc:288] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:35.539350 23740 raft_consensus.cc:374] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:35.541646 23740 raft_consensus.cc:729] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:35.542598 23740 consensus_queue.cc:260] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:35.548676 23740 ts_tablet_manager.cc:1428] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.021s user 0.011s sys 0.000s
I20260807 13:38:35.550060 23740 tablet_bootstrap.cc:492] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:35.564220 23737 tablet_bootstrap.cc:654] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:35.578310 23740 tablet_bootstrap.cc:654] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:35.579397 23739 tablet_bootstrap.cc:492] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
W20260807 13:38:35.691761 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 260991us
I20260807 13:38:35.793262 24143 raft_consensus.cc:482] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:35.793078 23942 raft_consensus.cc:482] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:35.794854 24158 raft_consensus.cc:482] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:35.796087 24159 raft_consensus.cc:482] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:36.082580 24159 raft_consensus.cc:504] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.084245 24158 raft_consensus.cc:504] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:35.797559 23899 raft_consensus.cc:482] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:35.798035 24188 raft_consensus.cc:482] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:36.110239 24193 raft_consensus.cc:482] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:36.109978 24143 raft_consensus.cc:504] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.111260 24193 raft_consensus.cc:504] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.113603 24143 leader_election.cc:288] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:36.114233 24193 leader_election.cc:288] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:36.114611 24188 raft_consensus.cc:504] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:35.794888 24174 raft_consensus.cc:482] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:36.121161 24188 leader_election.cc:288] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:36.333700 24190 raft_consensus.cc:482] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:36.332261 23739 ts_tablet_manager.cc:1397] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 1.127s user 0.018s sys 0.013s
W20260807 13:38:36.336453 23633 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.69.2:33363 timed out after 1.912s (SENT) [suppressed 2 similar messages]
I20260807 13:38:36.332581 23899 raft_consensus.cc:504] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.328495 23942 raft_consensus.cc:504] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.350682 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:36.352945 23481 raft_consensus.cc:2454] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 0.
I20260807 13:38:36.353140 23479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 159) took 1387 ms. Trace:
I20260807 13:38:36.353732 23479 rpcz_store.cc:276] 0807 13:38:34.965231 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:36.332405 (+1367174us) service_pool.cc:227] Handling call
0807 13:38:36.348711 (+ 16306us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:36.352381 (+ 3670us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:36.352436 (+ 55us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:36.352505 (+ 69us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:36.352571 (+ 66us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:36.352680 (+ 109us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:36.352883 (+ 203us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:36.354740 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:36.355922 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:36.356748 23479 raft_consensus.cc:2454] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:36.357446 24159 leader_election.cc:288] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:36.337218 24174 raft_consensus.cc:504] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.357973 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:36.359066 23479 raft_consensus.cc:2454] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:36.357885 23942 leader_election.cc:288] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:36.361008 24174 leader_election.cc:288] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:36.361543 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:36.362883 23481 raft_consensus.cc:2454] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:36.363544 24158 leader_election.cc:288] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:36.364002 23430 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.638s user 0.003s sys 0.021s
I20260807 13:38:36.342655 24190 raft_consensus.cc:504] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:36.365984 23536 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.157s user 0.008s sys 0.019s
W20260807 13:38:36.366588 23536 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.158s user 0.008s sys 0.019s
I20260807 13:38:36.366829 24190 leader_election.cc:288] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:36.367213 23740 tablet_bootstrap.cc:492] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:36.356781 23737 tablet_bootstrap.cc:492] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
W20260807 13:38:36.348917 23428 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.632s user 0.009s sys 0.008s
W20260807 13:38:36.364666 23430 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.671s user 0.004s sys 0.021s
I20260807 13:38:36.377455 23740 ts_tablet_manager.cc:1397] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.828s user 0.016s sys 0.042s
W20260807 13:38:36.374395 23428 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.682s user 0.009s sys 0.008s
I20260807 13:38:36.380180 23737 ts_tablet_manager.cc:1397] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.859s user 0.014s sys 0.004s
I20260807 13:38:36.380352 24190 raft_consensus.cc:482] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:36.379806 24174 raft_consensus.cc:482] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:36.391580 24174 raft_consensus.cc:504] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.391620 24190 raft_consensus.cc:504] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.381844 24151 raft_consensus.cc:482] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:36.394569 24151 raft_consensus.cc:504] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.382733 24188 raft_consensus.cc:482] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:36.383193 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
W20260807 13:38:36.385977 23631 leader_election.cc:341] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:36.381990 23899 leader_election.cc:288] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:36.406050 23473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 72) took 2473 ms. Trace:
I20260807 13:38:36.423980 23473 rpcz_store.cc:276] 0807 13:38:33.946365 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:33.966086 (+ 19721us) service_pool.cc:227] Handling call
0807 13:38:34.120111 (+154025us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:34.186395 (+ 66284us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:34.200241 (+ 13846us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:34.203727 (+ 3486us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:34.232786 (+ 29059us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:36.405409 (+2172623us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:36.405750 (+ 341us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:36.407197 24188 raft_consensus.cc:504] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:36.426251 23632 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.202s user 0.034s sys 0.060s
W20260807 13:38:36.426856 23632 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.223s user 0.034s sys 0.060s
I20260807 13:38:36.403889 23740 raft_consensus.cc:348] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.412578 24159 raft_consensus.cc:482] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:36.414165 23942 raft_consensus.cc:482] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:36.430739 23942 raft_consensus.cc:504] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.433029 24193 raft_consensus.cc:482] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:36.433851 24193 raft_consensus.cc:504] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.434182 23942 leader_election.cc:288] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:36.414757 24158 raft_consensus.cc:482] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:36.435489 24158 raft_consensus.cc:504] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:36.436414 23533 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.231s user 0.021s sys 0.051s
I20260807 13:38:36.436645 23899 raft_consensus.cc:482] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:36.437343 23899 raft_consensus.cc:504] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.438555 24159 raft_consensus.cc:504] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.439356 23475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 76) took 1549 ms. Trace:
I20260807 13:38:36.439845 23475 rpcz_store.cc:276] 0807 13:38:34.889666 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:36.437822 (+1548156us) service_pool.cc:227] Handling call
0807 13:38:36.438433 (+ 611us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:36.438807 (+ 374us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:36.438839 (+ 32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:36.438899 (+ 60us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:36.438931 (+ 32us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:36.439015 (+ 84us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:36.439151 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:36.436465 24193 leader_election.cc:288] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:36.441766 24159 leader_election.cc:288] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:36.442093 23532 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.254s user 0.056s sys 0.124s
I20260807 13:38:36.428215 24188 leader_election.cc:288] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:36.446205 23480 raft_consensus.cc:3037] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:36.415985 24190 leader_election.cc:288] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:36.415489 23739 raft_consensus.cc:348] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.417888 23478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 160) took 1452 ms. Trace:
I20260807 13:38:36.450470 23472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 161) took 1484 ms. Trace:
W20260807 13:38:36.451139 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 65466.5us
I20260807 13:38:36.452729 23739 raft_consensus.cc:374] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:36.428723 23740 raft_consensus.cc:374] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:36.467185 23739 raft_consensus.cc:729] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:36.467368 23740 raft_consensus.cc:729] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
W20260807 13:38:36.461352 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 147526us
W20260807 13:38:36.461790 23532 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.274s user 0.056s sys 0.124s
I20260807 13:38:36.463546 24195 raft_consensus.cc:482] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
W20260807 13:38:36.464046 23533 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.259s user 0.021s sys 0.051s
I20260807 13:38:36.464613 24196 raft_consensus.cc:482] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:36.454571 23478 rpcz_store.cc:276] 0807 13:38:34.965534 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:36.396869 (+1431335us) service_pool.cc:227] Handling call
0807 13:38:36.399166 (+ 2297us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:36.417067 (+ 17901us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:36.417133 (+ 66us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:36.417224 (+ 91us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:36.417310 (+ 86us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:36.417434 (+ 124us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:36.417635 (+ 201us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:36.465606 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:36.444319 24158 leader_election.cc:288] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:36.475950 23740 consensus_queue.cc:260] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.468772 24196 raft_consensus.cc:504] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.480365 24196 leader_election.cc:288] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:36.481278 24195 raft_consensus.cc:504] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.484165 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:36.485405 23478 raft_consensus.cc:2454] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:36.486625 24195 leader_election.cc:288] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:36.486675 23737 raft_consensus.cc:348] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.500123 23737 raft_consensus.cc:374] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:36.500548 23737 raft_consensus.cc:729] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:36.472074 23739 consensus_queue.cc:260] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.467800 23899 leader_election.cc:288] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:36.466724 23472 rpcz_store.cc:276] 0807 13:38:34.965806 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:36.447128 (+1481322us) service_pool.cc:227] Handling call
0807 13:38:36.449338 (+ 2210us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:36.449658 (+ 320us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:36.449707 (+ 49us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:36.449793 (+ 86us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:36.449848 (+ 55us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:36.449936 (+ 88us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:36.450131 (+ 195us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:36.498572 23480 raft_consensus.cc:2454] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:36.508021 23737 consensus_queue.cc:260] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.508967 23740 ts_tablet_manager.cc:1428] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.131s user 0.009s sys 0.005s
I20260807 13:38:36.511202 23737 ts_tablet_manager.cc:1428] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.114s user 0.002s sys 0.007s
I20260807 13:38:36.516288 23739 ts_tablet_manager.cc:1428] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.171s user 0.012s sys 0.000s
W20260807 13:38:36.520169 23631 leader_election.cc:341] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:36.520665 24201 raft_consensus.cc:482] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:36.521230 23740 tablet_bootstrap.cc:492] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:36.521844 23631 leader_election.cc:302] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:36.521486 24201 raft_consensus.cc:504] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.528633 24188 raft_consensus.cc:2781] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:36.529217 24188 raft_consensus.cc:482] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:36.529667 23739 tablet_bootstrap.cc:492] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:36.530372 23631 leader_election.cc:302] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:36.529603 24188 raft_consensus.cc:3037] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:36.536163 24190 raft_consensus.cc:2781] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:36.536717 24190 raft_consensus.cc:482] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:36.537216 24190 raft_consensus.cc:3037] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:36.517174 24174 leader_election.cc:288] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:36.538055 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:36.550513 24174 raft_consensus.cc:482] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:36.551214 24174 raft_consensus.cc:504] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.551553 23899 raft_consensus.cc:482] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:36.552583 23899 raft_consensus.cc:504] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.564901 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:36.566128 23674 raft_consensus.cc:3037] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:36.561964 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:36.571327 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:36.572965 23681 raft_consensus.cc:3037] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:36.578706 24174 leader_election.cc:288] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:36.582562 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:36.584028 23469 raft_consensus.cc:2454] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:38:36.584290 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:36.589735 24200 raft_consensus.cc:482] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:36.590435 24200 raft_consensus.cc:504] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.592653 24200 leader_election.cc:288] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:36.593217 24200 raft_consensus.cc:482] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:36.593793 24200 raft_consensus.cc:504] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.594552 24188 raft_consensus.cc:504] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.596007 23679 raft_consensus.cc:2379] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 1: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:36.598213 24203 raft_consensus.cc:482] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:36.598320 24151 leader_election.cc:288] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:36.600301 24201 leader_election.cc:288] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:36.601085 24201 raft_consensus.cc:482] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:36.603628 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:36.562302 23631 leader_election.cc:302] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:36.604410 23676 raft_consensus.cc:2454] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:36.601933 24201 raft_consensus.cc:504] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.599071 24203 raft_consensus.cc:504] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.611126 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:36.604414 23674 raft_consensus.cc:2454] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:36.618134 24151 raft_consensus.cc:2781] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:36.618633 24151 raft_consensus.cc:482] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:36.619029 24151 raft_consensus.cc:3037] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:36.621335 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:36.622269 23676 raft_consensus.cc:2454] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:36.625057 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:36.615907 24200 leader_election.cc:288] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:36.615343 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 53212.4us
I20260807 13:38:36.679015 23429 leader_election.cc:302] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:36.686424 23671 raft_consensus.cc:3037] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:36.687920 23942 raft_consensus.cc:2781] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:36.686483 24201 leader_election.cc:288] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:36.688460 23942 raft_consensus.cc:482] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:36.688966 23942 raft_consensus.cc:3037] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:38:36.688196 23535 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.448s user 0.025s sys 0.017s
W20260807 13:38:36.689970 23535 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.453s user 0.026s sys 0.017s
I20260807 13:38:36.689652 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:36.690904 23577 raft_consensus.cc:2454] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:38:36.692988 24208 raft_consensus.cc:482] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:36.693743 24208 raft_consensus.cc:504] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.674006 24151 raft_consensus.cc:504] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.696480 24208 leader_election.cc:288] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:36.651999 24206 raft_consensus.cc:482] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:36.697650 23899 leader_election.cc:288] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:36.697873 24151 leader_election.cc:288] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:36.697544 24206 raft_consensus.cc:504] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.700384 24206 leader_election.cc:288] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:36.700244 23429 leader_election.cc:302] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:36.703563 24159 raft_consensus.cc:2781] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:36.648092 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:36.704226 24159 raft_consensus.cc:482] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:36.704664 24159 raft_consensus.cc:3037] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:36.651280 24203 leader_election.cc:288] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:36.642386 24205 raft_consensus.cc:482] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:36.648015 24188 leader_election.cc:288] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:36.642216 24190 raft_consensus.cc:504] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.640220 24207 raft_consensus.cc:482] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:36.639655 24195 raft_consensus.cc:482] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:36.644726 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:36.702322 23631 leader_election.cc:302] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:36.709125 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:36.709570 24196 consensus_queue.cc:1035] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:36.647023 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:36.634274 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:36.716444 24207 raft_consensus.cc:504] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.712723 24200 raft_consensus.cc:482] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:36.718570 24195 raft_consensus.cc:504] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.719769 24201 raft_consensus.cc:482] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:36.720433 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:36.724416 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 54740.7us
I20260807 13:38:36.726238 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:36.731597 23680 raft_consensus.cc:2379] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 1: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:36.733174 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:36.733945 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:36.734581 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:36.735222 23680 raft_consensus.cc:2454] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:36.733201 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:36.741133 23672 raft_consensus.cc:2454] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:36.741365 24188 raft_consensus.cc:2781] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:36.741941 24188 raft_consensus.cc:482] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:36.742437 24188 raft_consensus.cc:3037] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:36.727727 24203 raft_consensus.cc:482] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:36.742376 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:36.747242 24195 leader_election.cc:288] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:36.744148 24203 raft_consensus.cc:504] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.747848 24200 raft_consensus.cc:504] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.735616 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:36.750594 24203 leader_election.cc:288] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:36.758491 24201 raft_consensus.cc:504] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.764099 24207 leader_election.cc:288] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:36.730710 23671 raft_consensus.cc:2454] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:36.759204 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:36.766659 24214 raft_consensus.cc:482] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:36.749830 23675 raft_consensus.cc:2454] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:36.770854 23578 raft_consensus.cc:2454] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:36.744171 23942 raft_consensus.cc:504] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.773198 23942 leader_election.cc:288] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:36.764719 23674 raft_consensus.cc:2454] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:36.773881 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:36.767216 24214 raft_consensus.cc:504] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.769608 24201 leader_election.cc:288] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:36.739770 24205 raft_consensus.cc:504] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.776567 23684 raft_consensus.cc:2379] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 2: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:36.778924 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:36.781459 23573 raft_consensus.cc:2454] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:38:36.783432 24209 raft_consensus.cc:482] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:36.791491 24200 leader_election.cc:288] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:36.800256 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:36.796048 24169 raft_consensus.cc:482] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:36.802013 24196 raft_consensus.cc:482] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:36.803308 24195 raft_consensus.cc:482] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:36.802852 24190 leader_election.cc:288] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:36.805644 24205 leader_election.cc:288] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:36.798840 23942 consensus_queue.cc:1035] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260807 13:38:36.805959 24214 leader_election.cc:288] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:36.805740 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:36.790297 24211 raft_consensus.cc:482] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:36.810061 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:36.784103 24209 raft_consensus.cc:504] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:38:36.795557 24159 raft_consensus.cc:504] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.814149 23346 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41372 (request call id 66) took 3022 ms. Trace:
I20260807 13:38:36.806131 24203 raft_consensus.cc:482] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:36.807350 24169 raft_consensus.cc:504] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:38:36.816606 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:36.805076 24196 raft_consensus.cc:504] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.824419 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:36.825099 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:36.825822 23575 raft_consensus.cc:2454] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 0.
I20260807 13:38:36.824816 24215 raft_consensus.cc:482] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:36.826812 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:36.835692 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:36.817862 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:36.834046 23631 leader_election.cc:302] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:36.827771 24214 raft_consensus.cc:482] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:36.837035 23740 tablet_bootstrap.cc:700] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1: Time spent opening tablet: real 0.265s user 0.005s sys 0.001s
I20260807 13:38:36.841125 23740 tablet_bootstrap.cc:654] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:36.836551 23572 raft_consensus.cc:2454] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:36.817379 24195 raft_consensus.cc:504] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:36.869329 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 50513.5us
I20260807 13:38:36.853796 23739 tablet_bootstrap.cc:654] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:36.820756 24211 raft_consensus.cc:504] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.919157 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:36.920610 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:36.920845 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:36.922190 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:36.922506 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:36.922618 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:36.846324 24203 raft_consensus.cc:504] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.837456 24205 raft_consensus.cc:482] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:36.859733 24200 raft_consensus.cc:482] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:36.905436 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 76737.6us
I20260807 13:38:36.908303 23429 leader_election.cc:302] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:36.908557 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:36.867257 23344 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41390 (request call id 67) took 2904 ms. Trace:
I20260807 13:38:36.911443 24190 raft_consensus.cc:2781] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:36.867901 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:36.935482 23677 raft_consensus.cc:3037] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:38:36.937723 23407 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:38:36.935025 23737 tablet_bootstrap.cc:492] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:36.932143 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:36.815618 23346 rpcz_store.cc:276] 0807 13:38:33.791545 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:33.791702 (+ 157us) service_pool.cc:227] Handling call
0807 13:38:36.813897 (+3022195us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:38:33.949382 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:38:33.949824 (+ 442us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:38:33.949863 (+ 39us) write_op.cc:435] Acquired schema lock
0807 13:38:33.949881 (+ 18us) tablet.cc:660] Decoding operations
0807 13:38:33.950260 (+ 379us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:38:33.950305 (+ 45us) write_op.cc:641] Partition lock acquired for write op
0807 13:38:33.950329 (+ 24us) tablet.cc:683] Acquiring locks for 2 operations
0807 13:38:33.950655 (+ 326us) tablet.cc:699] Row locks acquired
0807 13:38:33.950674 (+ 19us) write_op.cc:260] PREPARE: finished
0807 13:38:33.950820 (+ 146us) write_op.cc:270] Start()
0807 13:38:33.950934 (+ 114us) write_op.cc:276] Timestamp: P: 1786109913950766 usec, L: 0
0807 13:38:33.950956 (+ 22us) op_driver.cc:331] REPLICATION: starting
0807 13:38:33.957909 (+ 6953us) log.cc:842] Serialized 916 byte log entry
0807 13:38:34.964483 (+1006574us) op_driver.cc:444] REPLICATION: finished
0807 13:38:34.964851 (+ 368us) write_op.cc:301] APPLY: starting
0807 13:38:34.965290 (+ 439us) tablet.cc:1365] starting BulkCheckPresence
0807 13:38:34.965408 (+ 118us) tablet.cc:1368] finished BulkCheckPresence
0807 13:38:34.965507 (+ 99us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:38:34.965784 (+ 277us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:38:34.965940 (+ 156us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0807 13:38:34.965985 (+ 45us) write_op.cc:312] APPLY: finished
0807 13:38:34.966191 (+ 206us) log.cc:842] Serialized 28 byte log entry
0807 13:38:35.005740 (+ 39549us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:38:35.102207 (+ 96467us) write_op.cc:454] Released schema lock
0807 13:38:35.112595 (+ 10388us) write_op.cc:341] FINISH: Updating metrics
0807 13:38:35.112863 (+ 268us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:38:35.112889 (+ 26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1479465,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":115,"apply.run_cpu_time_us":2224,"apply.run_wall_time_us":148302,"num_ops":2,"prepare.queue_time_us":49481,"prepare.run_cpu_time_us":2805,"prepare.run_wall_time_us":8797,"replication_time_us":1012610}]]}
I20260807 13:38:36.914523 24196 leader_election.cc:288] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:36.936348 23631 leader_election.cc:302] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:36.865085 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:36.916960 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:36.862990 24209 leader_election.cc:288] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765), e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037)
I20260807 13:38:36.941859 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:36.942025 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:36.924372 24211 leader_election.cc:288] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:36.869695 24214 raft_consensus.cc:504] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.948572 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:36.949074 24159 leader_election.cc:288] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:36.938736 24190 raft_consensus.cc:482] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:36.953753 24190 raft_consensus.cc:3037] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:36.938282 23344 rpcz_store.cc:276] 0807 13:38:33.962965 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:36.382927 (+2419962us) service_pool.cc:227] Handling call
0807 13:38:36.867044 (+484117us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":372005,"reported_tablets":3}
I20260807 13:38:36.944186 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:36.943862 24201 raft_consensus.cc:482] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:36.945676 24200 raft_consensus.cc:504] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.945915 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:36.884615 24215 raft_consensus.cc:504] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.962317 24151 raft_consensus.cc:2781] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:36.963107 23470 raft_consensus.cc:2454] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:36.963048 24201 raft_consensus.cc:504] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.963502 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:36.946154 23942 raft_consensus.cc:2781] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:36.964605 23429 leader_election.cc:302] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:36.953025 24169 leader_election.cc:288] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:36.941951 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:36.966728 24188 raft_consensus.cc:504] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:36.944840 24205 raft_consensus.cc:504] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:37.131055 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 177364us
I20260807 13:38:37.145998 24151 raft_consensus.cc:482] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:37.152055 24151 raft_consensus.cc:3037] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:37.153901 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:37.154752 23480 raft_consensus.cc:2454] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:36.983669 24174 raft_consensus.cc:482] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:37.155390 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:36.972438 23469 raft_consensus.cc:2379] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 1: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:36.971566 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:36.971689 23899 raft_consensus.cc:482] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:36.985684 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:37.128050 24195 leader_election.cc:288] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.106895 24159 raft_consensus.cc:482] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:37.138347 24214 leader_election.cc:288] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.156147 24174 raft_consensus.cc:504] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.128279 24203 leader_election.cc:288] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.144210 23942 raft_consensus.cc:482] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:36.979103 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:36.975821 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:37.168831 24209 consensus_queue.cc:1035] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260807 13:38:37.176584 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.157938 23577 raft_consensus.cc:2454] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:37.218185 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.220507 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.177377 23737 tablet_bootstrap.cc:654] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:37.164412 24169 raft_consensus.cc:2781] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:37.033829 24204 raft_consensus.cc:482] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:37.224224 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.225786 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.227130 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.181362 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:37.183578 24151 raft_consensus.cc:504] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.232597 23684 raft_consensus.cc:1226] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4. Ops: []
I20260807 13:38:37.184172 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:37.231936 24151 leader_election.cc:288] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:37.235792 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.236619 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.237119 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.238150 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.238425 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.239279 23674 raft_consensus.cc:2379] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 1: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:37.239836 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.240281 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.241061 23674 raft_consensus.cc:2454] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:37.241106 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.242256 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.242473 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.244103 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.244499 23469 raft_consensus.cc:2454] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:37.223443 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.247781 23472 raft_consensus.cc:2454] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:37.249044 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.249907 23581 raft_consensus.cc:2454] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:38:37.250990 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.222244 23573 raft_consensus.cc:2454] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:38:37.226924 24201 leader_election.cc:288] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.185487 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.253233 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.189572 24205 leader_election.cc:288] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.258351 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.195436 24200 leader_election.cc:288] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.196130 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:37.259943 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:37.258139 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.261380 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.199460 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:37.201334 24188 leader_election.cc:288] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:37.215350 23942 raft_consensus.cc:3037] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:37.263602 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.202205 23677 raft_consensus.cc:2454] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:37.210266 23470 raft_consensus.cc:1226] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:37.212013 24174 leader_election.cc:288] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:37.213714 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.214016 23681 raft_consensus.cc:1226] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:37.214185 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:37.216213 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.212515 23899 raft_consensus.cc:504] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.268724 23676 raft_consensus.cc:1226] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:37.269340 23740 tablet_bootstrap.cc:492] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:37.269945 23740 ts_tablet_manager.cc:1397] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.749s user 0.013s sys 0.026s
I20260807 13:38:37.217656 24215 leader_election.cc:288] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.227461 24169 raft_consensus.cc:482] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:37.215544 24159 raft_consensus.cc:504] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.229033 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.229291 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.273622 23574 raft_consensus.cc:3037] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:38:37.229667 23532 consensus_peers.cc:487] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 -> Peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Couldn't send request to peer e11cad1eeaf5424c94e51241096f6613. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:38:37.221093 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:37.165170 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 200702us
I20260807 13:38:37.255203 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.277982 23578 raft_consensus.cc:2454] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:38:37.263873 24204 raft_consensus.cc:504] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.256903 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.198458 24190 raft_consensus.cc:504] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:37.279604 23429 leader_election.cc:341] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:37.269438 24195 consensus_queue.cc:1035] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:37.271610 24169 raft_consensus.cc:3037] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:37.284063 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.272835 23899 leader_election.cc:288] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
W20260807 13:38:37.274900 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 91330.2us
I20260807 13:38:37.276996 23572 raft_consensus.cc:2379] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 1: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:37.262835 23580 raft_consensus.cc:2454] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:37.277585 23740 raft_consensus.cc:348] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.284830 23671 raft_consensus.cc:2454] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:37.287932 23532 leader_election.cc:302] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:37.291783 23533 leader_election.cc:302] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:37.300805 23740 raft_consensus.cc:374] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:37.300197 23430 leader_election.cc:302] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:37.301661 23740 raft_consensus.cc:729] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:37.304563 23532 leader_election.cc:302] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:37.302650 23740 consensus_queue.cc:260] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.291291 23675 raft_consensus.cc:1226] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:37.311620 24201 consensus_queue.cc:1046] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:38:37.313148 24196 raft_consensus.cc:2781] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:37.313230 24201 raft_consensus.cc:3032] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:38:37.313691 24196 raft_consensus.cc:482] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:37.313879 24201 raft_consensus.cc:729] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:37.315147 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.315964 23739 tablet_bootstrap.cc:492] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
W20260807 13:38:37.308902 23429 consensus_peers.cc:487] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 -> Peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Couldn't send request to peer 5e0ea5aa0c6d4846a5ccc9962342e17a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:38:37.316447 23739 ts_tablet_manager.cc:1397] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.787s user 0.020s sys 0.008s
I20260807 13:38:37.313802 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.314169 24196 raft_consensus.cc:3037] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:37.305553 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.317301 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.318730 23533 leader_election.cc:302] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:37.304414 24215 raft_consensus.cc:2726] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:37.321803 23674 raft_consensus.cc:2454] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:37.320888 24205 raft_consensus.cc:2781] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:37.293262 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.320600 23430 leader_election.cc:302] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:37.321817 24204 leader_election.cc:288] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.324491 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.325730 24195 raft_consensus.cc:2726] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:37.326182 24214 raft_consensus.cc:2781] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:37.316841 23429 leader_election.cc:302] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:37.315238 24201 consensus_queue.cc:260] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.328644 23677 raft_consensus.cc:2454] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:37.329627 24201 raft_consensus.cc:3037] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:37.335186 23739 raft_consensus.cc:348] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.336014 23739 raft_consensus.cc:374] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:37.336313 23739 raft_consensus.cc:729] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:37.332000 24227 consensus_queue.cc:1035] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260807 13:38:37.337992 24215 raft_consensus.cc:2726] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:38:37.337335 23533 leader_election.cc:341] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:37.341060 23533 leader_election.cc:302] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:37.323343 24205 raft_consensus.cc:482] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:37.335852 24195 raft_consensus.cc:2781] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:37.336925 23739 consensus_queue.cc:260] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.342963 23533 leader_election.cc:302] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:37.343703 23532 leader_election.cc:302] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:37.344612 23533 leader_election.cc:302] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:37.345422 23533 leader_election.cc:302] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:37.344094 24195 raft_consensus.cc:482] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:37.346349 24195 raft_consensus.cc:3037] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:37.346241 24169 raft_consensus.cc:504] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.347889 24200 raft_consensus.cc:2781] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:37.348276 24200 raft_consensus.cc:482] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:37.348475 24169 leader_election.cc:288] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.348634 24200 raft_consensus.cc:3037] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:37.348591 24209 raft_consensus.cc:2726] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:37.342485 24205 raft_consensus.cc:3037] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:37.348703 23532 leader_election.cc:302] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:37.350368 24215 raft_consensus.cc:2781] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:37.350660 23430 leader_election.cc:302] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:37.324167 24190 leader_election.cc:288] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:37.344044 24204 raft_consensus.cc:2726] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:38:37.355415 23533 leader_election.cc:341] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:37.357980 23740 ts_tablet_manager.cc:1428] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.088s user 0.010s sys 0.003s
I20260807 13:38:37.354440 24215 raft_consensus.cc:482] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:37.358676 24169 raft_consensus.cc:2781] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:37.358836 24215 raft_consensus.cc:3037] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:37.359057 23737 tablet_bootstrap.cc:492] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:37.359112 24169 raft_consensus.cc:482] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:37.359675 24169 raft_consensus.cc:3037] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:37.359793 23737 ts_tablet_manager.cc:1397] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.425s user 0.026s sys 0.006s
I20260807 13:38:37.359786 24209 raft_consensus.cc:2781] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:37.362418 24209 raft_consensus.cc:482] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:37.362851 24209 raft_consensus.cc:3037] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:37.362952 23739 ts_tablet_manager.cc:1428] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.046s user 0.007s sys 0.000s
I20260807 13:38:37.365538 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.374096 23739 tablet_bootstrap.cc:492] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:37.357549 24159 leader_election.cc:288] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.354357 24214 raft_consensus.cc:482] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:37.381956 24214 raft_consensus.cc:3037] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:37.352991 23429 leader_election.cc:302] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:37.377630 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.383886 23430 leader_election.cc:302] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:37.384784 24159 raft_consensus.cc:2781] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:37.385205 24159 raft_consensus.cc:482] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:37.385563 24159 raft_consensus.cc:3037] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:37.387147 23430 leader_election.cc:302] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:37.387964 23740 tablet_bootstrap.cc:492] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:37.389344 24227 raft_consensus.cc:2726] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:37.390251 23533 leader_election.cc:302] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:37.390740 24227 raft_consensus.cc:2781] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:37.391160 24227 raft_consensus.cc:482] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:37.391249 24204 raft_consensus.cc:2726] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:37.391571 24227 raft_consensus.cc:3037] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:37.393060 23430 leader_election.cc:302] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:37.399232 23533 leader_election.cc:302] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:37.402226 23533 leader_election.cc:302] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:37.399927 24230 consensus_queue.cc:1046] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:37.407799 24211 raft_consensus.cc:2726] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:37.408485 24203 raft_consensus.cc:2726] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:37.407330 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.416651 24203 consensus_queue.cc:1046] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:38:37.417074 23533 leader_election.cc:302] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:37.417294 24240 raft_consensus.cc:2726] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:37.418206 23533 leader_election.cc:302] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:37.418337 24203 raft_consensus.cc:3032] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:37.421257 24210 raft_consensus.cc:2781] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:37.421808 24203 raft_consensus.cc:729] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:37.421970 24210 raft_consensus.cc:482] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:37.421000 24212 raft_consensus.cc:2726] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:37.422500 24210 raft_consensus.cc:3037] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:37.419091 24230 raft_consensus.cc:3032] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:37.423010 24230 raft_consensus.cc:729] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:37.426363 23533 leader_election.cc:302] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:37.428809 23533 leader_election.cc:302] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:37.427444 24230 consensus_queue.cc:260] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.432698 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.433393 24230 raft_consensus.cc:3037] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:37.427824 24211 consensus_queue.cc:1046] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:38:37.438479 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:37.439282 23578 raft_consensus.cc:3037] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:37.441332 23942 raft_consensus.cc:504] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.442641 23481 raft_consensus.cc:1226] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:37.443717 23942 leader_election.cc:288] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.444254 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.444787 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:37.433844 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.453308 23430 leader_election.cc:302] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:37.445247 24212 raft_consensus.cc:2781] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:37.455101 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "608f7e63bc4648e0890e5f601c52736c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.461285 24241 raft_consensus.cc:2726] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:37.461694 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
W20260807 13:38:37.450217 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 107258us
W20260807 13:38:37.470693 23533 leader_election.cc:341] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:37.452606 23575 raft_consensus.cc:2362] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1. Re-sending same reply.
I20260807 13:38:37.436014 24215 raft_consensus.cc:504] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.475703 24206 raft_consensus.cc:2781] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:37.474390 23737 raft_consensus.cc:348] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.476532 23737 raft_consensus.cc:374] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:37.457000 24212 raft_consensus.cc:482] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:37.476830 23737 raft_consensus.cc:729] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:37.480099 23737 consensus_queue.cc:260] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.484318 23739 tablet_bootstrap.cc:654] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:37.477032 24212 raft_consensus.cc:3037] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:37.487357 24215 leader_election.cc:288] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.453099 24203 consensus_queue.cc:260] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.507561 24206 raft_consensus.cc:482] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:37.508066 24206 raft_consensus.cc:3037] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:38:37.512893 23429 leader_election.cc:341] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:37.513448 23429 leader_election.cc:302] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:37.486469 24200 raft_consensus.cc:504] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.515619 23578 raft_consensus.cc:2454] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:37.517467 23429 leader_election.cc:302] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:37.524673 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:37.525164 23674 raft_consensus.cc:1226] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:37.512110 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:37.539474 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:37.544927 23674 raft_consensus.cc:3037] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:37.511425 23574 raft_consensus.cc:2454] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:37.526850 23942 raft_consensus.cc:2781] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:37.509133 24196 raft_consensus.cc:504] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.528649 24204 raft_consensus.cc:3032] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:37.545547 24203 raft_consensus.cc:3037] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:38:37.562422 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 107601us
I20260807 13:38:37.550287 24207 raft_consensus.cc:2726] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:37.516409 24169 raft_consensus.cc:504] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.564260 23430 leader_election.cc:302] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:37.551672 24200 leader_election.cc:288] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.552595 23942 raft_consensus.cc:482] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:37.552335 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:37.557653 24204 raft_consensus.cc:729] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:37.550037 24201 consensus_queue.cc:1046] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
W20260807 13:38:37.581652 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 64221.7us
I20260807 13:38:37.596580 23737 ts_tablet_manager.cc:1428] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.236s user 0.006s sys 0.003s
I20260807 13:38:37.581961 23942 raft_consensus.cc:3037] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:37.584578 24240 raft_consensus.cc:3037] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:37.581714 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.562533 24209 raft_consensus.cc:504] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.601763 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:37.607370 23711 debug-util.cc:398] Leaking SignalData structure 0x7b08001da420 after lost signal to thread 21785
I20260807 13:38:37.617861 23740 tablet_bootstrap.cc:654] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:37.599093 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
W20260807 13:38:37.608879 23711 debug-util.cc:398] Leaking SignalData structure 0x7b080014e280 after lost signal to thread 23392
I20260807 13:38:37.629012 23737 tablet_bootstrap.cc:492] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:37.635310 24190 raft_consensus.cc:482] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:37.636133 24190 raft_consensus.cc:504] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.643920 23429 leader_election.cc:302] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters: 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:37.638199 23577 raft_consensus.cc:2379] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 2: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:37.649117 24243 raft_consensus.cc:2741] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260807 13:38:37.626195 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.612607 24159 raft_consensus.cc:504] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.650408 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:37.654596 24211 raft_consensus.cc:482] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:37.681474 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 108902us
I20260807 13:38:37.682221 23430 leader_election.cc:302] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:37.656996 24196 leader_election.cc:288] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.660355 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.660638 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.680951 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.692950 24243 raft_consensus.cc:2781] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:38:37.659952 23631 leader_election.cc:302] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:37.679839 24207 raft_consensus.cc:482] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:37.677170 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:37.689476 23711 debug-util.cc:398] Leaking SignalData structure 0x7b080025dfc0 after lost signal to thread 23513
I20260807 13:38:37.698458 23899 raft_consensus.cc:2781] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:37.701892 24206 raft_consensus.cc:504] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.703907 23680 raft_consensus.cc:1226] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:37.703603 23633 leader_election.cc:302] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:37.681042 24211 raft_consensus.cc:504] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.714015 23430 leader_election.cc:302] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:37.695343 24196 raft_consensus.cc:482] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:37.724815 23679 raft_consensus.cc:1226] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:37.706101 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.685309 24195 raft_consensus.cc:504] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.698886 24169 leader_election.cc:288] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.728240 24242 raft_consensus.cc:3032] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:37.730458 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.730628 24227 raft_consensus.cc:504] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.731241 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.731817 24248 raft_consensus.cc:2781] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:37.728277 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:37.732417 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:37.735107 24174 raft_consensus.cc:2726] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:37.713024 24243 raft_consensus.cc:686] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:37.716848 23899 raft_consensus.cc:686] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:37.741664 23430 leader_election.cc:302] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:37.735545 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.733726 24209 leader_election.cc:288] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.699262 24207 raft_consensus.cc:504] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.744289 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.736706 24196 raft_consensus.cc:504] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.732801 24210 raft_consensus.cc:504] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.715251 24212 raft_consensus.cc:504] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.753541 23532 leader_election.cc:302] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:37.754875 24209 raft_consensus.cc:2726] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:37.751293 24190 leader_election.cc:288] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:37.755841 24239 raft_consensus.cc:2781] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:37.756266 24239 raft_consensus.cc:482] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:37.756700 24239 raft_consensus.cc:3037] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:37.756170 23532 leader_election.cc:302] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:37.757198 24207 leader_election.cc:288] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:37.748383 23711 debug-util.cc:398] Leaking SignalData structure 0x7b080025e7e0 after lost signal to thread 23613
I20260807 13:38:37.742329 24241 raft_consensus.cc:2781] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:37.743040 24242 raft_consensus.cc:729] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:37.768589 24255 raft_consensus.cc:482] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:37.698292 24246 consensus_queue.cc:1035] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.139s
I20260807 13:38:37.772641 24209 raft_consensus.cc:2726] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:37.773422 24246 consensus_queue.cc:1035] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:38:37.769153 24255 raft_consensus.cc:504] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.745797 24248 raft_consensus.cc:482] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:37.748238 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:37.748795 24201 consensus_queue.cc:1046] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260807 13:38:37.767565 24241 raft_consensus.cc:482] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:37.771811 24214 raft_consensus.cc:504] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:38:37.782176 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:37.781509 24248 raft_consensus.cc:3037] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:37.770855 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:37.783277 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:37.795564 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:37.840164 24196 leader_election.cc:288] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.799299 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:37.795446 23711 debug-util.cc:398] Leaking SignalData structure 0x7b08002445c0 after lost signal to thread 23714
I20260807 13:38:37.805333 23680 raft_consensus.cc:2379] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 4: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:37.806592 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.806773 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:37.780401 23674 raft_consensus.cc:2454] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:37.797219 23582 raft_consensus.cc:1226] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260807 13:38:37.808128 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:37.786885 24159 leader_election.cc:288] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.805888 24249 consensus_queue.cc:1046] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260807 13:38:37.789863 23633 leader_election.cc:302] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:37.800696 23899 consensus_queue.cc:237] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.781075 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:37.808420 24242 consensus_queue.cc:260] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.791399 24241 raft_consensus.cc:3037] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:37.834978 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.840215 23942 raft_consensus.cc:504] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.849259 23737 tablet_bootstrap.cc:654] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:37.796705 24210 leader_election.cc:288] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.797318 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "608f7e63bc4648e0890e5f601c52736c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:37.796638 24205 raft_consensus.cc:504] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.864771 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:37.865585 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:37.886404 24227 leader_election.cc:288] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.868477 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:37.868799 24242 raft_consensus.cc:3037] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:37.850813 24240 raft_consensus.cc:2726] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:37.852795 23480 raft_consensus.cc:1226] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:37.850708 23479 raft_consensus.cc:1226] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:37.851830 24211 leader_election.cc:288] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.807029 24243 consensus_queue.cc:237] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.886905 23572 raft_consensus.cc:2454] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:38:37.890165 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:37.890834 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:37.892328 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:37.893093 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:37.893719 24205 leader_election.cc:288] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.894340 24174 raft_consensus.cc:2726] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:37.895012 23578 raft_consensus.cc:2379] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 1: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:37.876966 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:37.888396 23481 raft_consensus.cc:3037] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:37.897293 23942 leader_election.cc:288] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.871716 24206 leader_election.cc:288] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.904772 23475 raft_consensus.cc:1226] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:37.904915 23473 raft_consensus.cc:1226] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:37.905508 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:37.905875 23582 raft_consensus.cc:1226] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260807 13:38:37.899474 23671 raft_consensus.cc:1226] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260807 13:38:37.906659 24227 consensus_queue.cc:1046] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:38:37.908128 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
W20260807 13:38:37.911842 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 131155us
I20260807 13:38:37.958148 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:37.959555 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:37.960824 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:37.962111 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:37.962934 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:37.963830 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:37.967172 24227 raft_consensus.cc:3032] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:37.918649 23679 raft_consensus.cc:2454] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:37.970995 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:37.971597 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:37.953506 24212 leader_election.cc:288] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.975162 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:37.972604 24227 raft_consensus.cc:729] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:37.965678 23680 raft_consensus.cc:3037] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:37.955802 23942 raft_consensus.cc:482] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:37.977559 23739 tablet_bootstrap.cc:492] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:37.965255 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:37.982960 23739 ts_tablet_manager.cc:1397] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.619s user 0.009s sys 0.019s
I20260807 13:38:37.983173 23942 raft_consensus.cc:504] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.985350 23942 leader_election.cc:288] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:37.986999 23429 leader_election.cc:302] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:37.986527 23739 raft_consensus.cc:348] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:37.987675 23739 raft_consensus.cc:374] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:37.988070 23739 raft_consensus.cc:729] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:37.989497 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:37.990381 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:37.990706 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:37.991616 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:37.993609 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:37.994894 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:37.996039 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:37.996650 23480 raft_consensus.cc:2454] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 0.
I20260807 13:38:37.997511 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:37.997910 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:37.998692 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:38.000023 23739 consensus_queue.cc:260] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.000768 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:38.001502 23429 leader_election.cc:302] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:38.001686 23574 raft_consensus.cc:2454] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4.
I20260807 13:38:38.001919 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
W20260807 13:38:38.002650 23429 leader_election.cc:341] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:38.002795 24246 raft_consensus.cc:2726] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.001822 23739 ts_tablet_manager.cc:1428] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20260807 13:38:38.003427 23429 leader_election.cc:302] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:38.003620 24246 raft_consensus.cc:2726] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:37.992377 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:37.979126 24214 leader_election.cc:288] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Requested vote from peers 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765), e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037)
I20260807 13:38:38.006814 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:38.003422 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:38.008414 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:38.008881 24201 raft_consensus.cc:3032] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Stepping down as leader of term 1
W20260807 13:38:38.009063 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 98215.8us
I20260807 13:38:38.009341 24201 raft_consensus.cc:729] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
W20260807 13:38:38.009747 23533 leader_election.cc:341] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:38.010267 24201 consensus_queue.cc:260] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.010902 23533 leader_election.cc:302] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:38.011818 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:38.013209 24240 raft_consensus.cc:2726] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.014093 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:38.014672 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:38.012984 23429 leader_election.cc:302] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
W20260807 13:38:38.015224 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 232373us
I20260807 13:38:38.014842 24227 consensus_queue.cc:260] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.015725 24240 raft_consensus.cc:2726] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.016117 24227 raft_consensus.cc:3037] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:38:38.016182 23532 leader_election.cc:341] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:38:38.017170 23533 leader_election.cc:341] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:38.016211 24200 consensus_queue.cc:1046] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:38.015933 24230 consensus_queue.cc:1046] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260807 13:38:38.022244 23532 leader_election.cc:302] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
W20260807 13:38:38.023767 23532 leader_election.cc:341] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:38:38.023986 23533 leader_election.cc:341] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:38.024227 23532 leader_election.cc:302] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:38.022433 24205 raft_consensus.cc:2781] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:38:38.024720 23533 leader_election.cc:302] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:38.031984 23429 leader_election.cc:302] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:38.026093 23475 raft_consensus.cc:2454] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 0.
I20260807 13:38:37.991847 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:38.039839 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:38.040935 24200 raft_consensus.cc:3032] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:38.041477 24209 raft_consensus.cc:2726] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 13:38:38.042948 23429 leader_election.cc:341] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:38.056668 23429 leader_election.cc:302] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:38.006821 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:38.044749 23430 leader_election.cc:302] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:38.041970 23481 raft_consensus.cc:2454] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:38.049257 24254 raft_consensus.cc:482] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:38.031322 24210 raft_consensus.cc:2726] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.042126 24246 raft_consensus.cc:2726] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:38:38.050716 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:38.051445 23740 tablet_bootstrap.cc:492] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:38.052454 23469 raft_consensus.cc:1226] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:38.031141 24230 raft_consensus.cc:3032] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:38.057556 23942 raft_consensus.cc:2726] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.035461 24201 raft_consensus.cc:3037] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:38.030380 24255 leader_election.cc:288] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:38.063711 23739 tablet_bootstrap.cc:492] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:38.053572 24200 raft_consensus.cc:729] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:38.064129 24212 raft_consensus.cc:2781] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:38.079707 24253 raft_consensus.cc:2781] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:38.080094 24212 raft_consensus.cc:482] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:38.071723 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:38.080570 24212 raft_consensus.cc:3037] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:38.055328 24205 raft_consensus.cc:686] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 2 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:38.081993 24205 consensus_queue.cc:237] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.067425 24230 raft_consensus.cc:729] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:38.076145 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:38.072793 23473 raft_consensus.cc:1226] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:38.064942 23740 ts_tablet_manager.cc:1397] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.682s user 0.030s sys 0.010s
I20260807 13:38:38.077136 24200 consensus_queue.cc:260] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.015751 24204 consensus_queue.cc:260] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.079100 23532 leader_election.cc:302] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:38.080178 24253 raft_consensus.cc:482] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:38.042661 23633 leader_election.cc:302] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:38.084904 24159 consensus_queue.cc:1046] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:38.071941 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:38.085698 24230 consensus_queue.cc:260] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.073035 24249 consensus_queue.cc:1046] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
W20260807 13:38:38.093266 24264 log.cc:924] Time spent T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.118s user 0.000s sys 0.001s
I20260807 13:38:38.058264 24254 raft_consensus.cc:504] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.098809 24211 consensus_queue.cc:1046] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:38:38.099601 23680 raft_consensus.cc:2454] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
W20260807 13:38:38.100440 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 69767.1us
W20260807 13:38:38.100993 24203 consensus_meta.cc:287] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.544s user 0.013s sys 0.000s
I20260807 13:38:38.098122 23429 leader_election.cc:302] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:38.105464 23532 leader_election.cc:302] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:38.088985 24239 raft_consensus.cc:504] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:38:38.107101 23429 leader_election.cc:302] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:38.104810 24174 raft_consensus.cc:2726] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.108824 24169 raft_consensus.cc:2726] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.096191 24253 raft_consensus.cc:3037] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:38.093948 24206 consensus_queue.cc:1046] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260807 13:38:38.109548 23429 leader_election.cc:302] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:38.113765 23429 leader_election.cc:302] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:38.096019 24209 raft_consensus.cc:2726] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.117784 24196 raft_consensus.cc:2726] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.121536 23479 raft_consensus.cc:1226] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:38.121739 23580 raft_consensus.cc:2454] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:38.122952 23532 leader_election.cc:302] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:38.090131 24248 raft_consensus.cc:504] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:38.125070 23533 leader_election.cc:341] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:38.126050 23470 raft_consensus.cc:2379] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 1: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:38.109437 23478 raft_consensus.cc:1226] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:38.125901 23533 leader_election.cc:302] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:38.112227 24200 raft_consensus.cc:3037] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:38.116580 23942 raft_consensus.cc:2726] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260807 13:38:38.140386 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 74815.6us
I20260807 13:38:38.144632 24211 raft_consensus.cc:2781] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:38:38.145103 24254 leader_election.cc:288] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:38.145328 24211 raft_consensus.cc:686] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 2 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:38.128167 24230 raft_consensus.cc:3037] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:38.150144 24251 raft_consensus.cc:2781] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:38:38.150638 24239 leader_election.cc:288] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:38.132041 24256 raft_consensus.cc:2726] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.122952 23633 leader_election.cc:302] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:38.146335 24211 consensus_queue.cc:237] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.166778 24174 raft_consensus.cc:2726] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.170293 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:38.170898 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:38.171744 23582 raft_consensus.cc:2379] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 1: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:38.171555 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:38.172008 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:38.172231 23481 raft_consensus.cc:2454] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:38.172662 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:38.173153 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:38.173084 23740 raft_consensus.cc:348] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.173857 23581 raft_consensus.cc:1226] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:38.174360 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:38.175055 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:38.175698 23575 raft_consensus.cc:2454] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:38.176085 23631 leader_election.cc:302] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:38.177068 23532 leader_election.cc:302] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:38.177240 24174 raft_consensus.cc:2726] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:38.178036 24208 raft_consensus.cc:2726] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.178953 23631 leader_election.cc:302] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:38.165313 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:38.179935 24174 raft_consensus.cc:2726] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.180382 23532 leader_election.cc:302] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:38.180579 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:38.181105 24208 raft_consensus.cc:2726] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.181285 23631 leader_election.cc:302] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:38.181054 24212 raft_consensus.cc:504] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.181705 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:38.182096 24174 raft_consensus.cc:2726] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.182495 23469 raft_consensus.cc:2379] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 1: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:38.183190 23631 leader_election.cc:302] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:38.165181 24260 raft_consensus.cc:2726] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260807 13:38:38.185494 23532 leader_election.cc:341] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:38.177345 24248 leader_election.cc:288] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:38.173904 23740 raft_consensus.cc:374] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:38.190632 23429 leader_election.cc:302] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:38.190579 23740 raft_consensus.cc:729] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:38.186512 23532 leader_election.cc:302] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:38.184010 24174 raft_consensus.cc:2726] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.183332 24241 raft_consensus.cc:504] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:38.188355 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 75866.1us
I20260807 13:38:38.197503 24208 raft_consensus.cc:2726] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.197721 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:38.198473 23480 raft_consensus.cc:2379] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 1: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:38.188625 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:38.198318 23633 leader_election.cc:302] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:38.188259 24169 consensus_queue.cc:1046] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:38.188179 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:38.198001 24241 leader_election.cc:288] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:38.193248 23532 leader_election.cc:302] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:38.195619 23740 consensus_queue.cc:260] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.217902 24256 raft_consensus.cc:2726] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:38:38.218261 24215 raft_consensus.cc:3032] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:38.218734 24215 raft_consensus.cc:729] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:38.220299 24212 leader_election.cc:288] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:38.219810 23740 ts_tablet_manager.cc:1428] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.129s user 0.007s sys 0.000s
I20260807 13:38:38.201798 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:38.221801 23573 raft_consensus.cc:2379] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 1: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:38.223209 23740 tablet_bootstrap.cc:492] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:38.225709 24195 leader_election.cc:288] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:38.202744 24169 raft_consensus.cc:2726] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.202944 23737 tablet_bootstrap.cc:492] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:38.228482 23737 ts_tablet_manager.cc:1397] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.612s user 0.018s sys 0.011s
I20260807 13:38:38.203390 24254 raft_consensus.cc:3032] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:38.205271 24174 raft_consensus.cc:2726] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.206146 23633 leader_election.cc:302] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:38.214157 24204 raft_consensus.cc:3037] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:38.268316 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
W20260807 13:38:38.269136 23429 leader_election.cc:341] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:38.271158 23429 leader_election.cc:302] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:38.270246 23631 leader_election.cc:302] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:38.272262 23676 raft_consensus.cc:3037] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:38.274787 23739 tablet_bootstrap.cc:654] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:38.276703 23429 leader_election.cc:302] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:38.278038 23429 leader_election.cc:302] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:38.230211 24254 raft_consensus.cc:729] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:38.283423 23740 tablet_bootstrap.cc:654] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:38.276856 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:38.244966 24215 consensus_queue.cc:260] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.284921 24248 raft_consensus.cc:2726] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:38:38.290024 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 83989.2us
I20260807 13:38:38.281461 24169 raft_consensus.cc:2726] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:38:38.305279 23469 raft_consensus.cc:1226] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:38.291740 24190 raft_consensus.cc:2726] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.293718 23942 raft_consensus.cc:2726] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.292058 24174 raft_consensus.cc:2741] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election decision vote started in defunct term 1: won
I20260807 13:38:38.409019 23471 raft_consensus.cc:2396] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:38:38.410197 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:38.340231 23633 leader_election.cc:302] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:38.345686 24215 raft_consensus.cc:3037] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:38.420260 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:38.345161 24251 raft_consensus.cc:686] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 2 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:38.326473 23631 leader_election.cc:302] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:38.347519 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:38.423221 23469 raft_consensus.cc:3037] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:38.440042 23671 raft_consensus.cc:2379] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 2: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
W20260807 13:38:38.440042 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 57448.4us
I20260807 13:38:38.464223 23740 tablet_bootstrap.cc:492] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:38.465651 23740 ts_tablet_manager.cc:1397] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.243s user 0.023s sys 0.035s
I20260807 13:38:38.443168 23680 raft_consensus.cc:2379] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 1: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:38.468876 23737 raft_consensus.cc:348] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.470844 23737 raft_consensus.cc:374] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:38.466768 24274 raft_consensus.cc:2726] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.472344 23737 raft_consensus.cc:729] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:38.479404 24190 raft_consensus.cc:2781] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:38.505312 24255 raft_consensus.cc:3032] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:38.499155 24284 raft_consensus.cc:482] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:38.345907 24254 consensus_queue.cc:260] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.518474 23575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 116) took 1035 ms. Trace:
W20260807 13:38:38.449787 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 119174us
W20260807 13:38:38.528280 23407 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:38:38.529244 23532 leader_election.cc:302] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:38.531191 23430 leader_election.cc:302] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
W20260807 13:38:38.573712 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 44562.4us
W20260807 13:38:38.525350 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 220609us
I20260807 13:38:38.476289 23737 consensus_queue.cc:260] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.544981 23740 raft_consensus.cc:348] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.586225 23740 raft_consensus.cc:374] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:38.558286 24190 raft_consensus.cc:686] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:38.554786 23429 leader_election.cc:302] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:38.587030 23740 raft_consensus.cc:729] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
W20260807 13:38:38.598450 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 113364us
I20260807 13:38:38.584403 23942 raft_consensus.cc:2726] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:38:38.564458 23575 rpcz_store.cc:276] 0807 13:38:37.490753 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:37.495939 (+ 5186us) service_pool.cc:227] Handling call
0807 13:38:38.497712 (+1001773us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b5400434ed4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:38.518295 (+ 20583us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":925427584}
I20260807 13:38:38.557394 24284 raft_consensus.cc:504] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.588613 24206 raft_consensus.cc:2726] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:38:38.426715 24251 consensus_queue.cc:237] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.553495 24255 raft_consensus.cc:729] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:38.546636 23346 catalog_manager.cc:5495] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3). New cstate: current_term: 1 leader_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: HEALTHY } } }
I20260807 13:38:38.606830 24190 consensus_queue.cc:237] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.627504 23739 tablet_bootstrap.cc:492] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:38.612810 23478 raft_consensus.cc:3037] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:38.630882 23739 ts_tablet_manager.cc:1397] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.587s user 0.054s sys 0.086s
I20260807 13:38:38.633051 23429 leader_election.cc:302] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:38.621698 23346 catalog_manager.cc:5495] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a reported cstate change: term changed from 0 to 1, leader changed from <none> to e11cad1eeaf5424c94e51241096f6613 (127.21.69.1). New cstate: current_term: 1 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } }
I20260807 13:38:38.524618 24253 raft_consensus.cc:504] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.606846 24159 raft_consensus.cc:2726] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.622396 23740 consensus_queue.cc:260] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.667906 23737 ts_tablet_manager.cc:1428] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.439s user 0.012s sys 0.009s
I20260807 13:38:38.628883 23573 raft_consensus.cc:1261] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:38.665902 24201 raft_consensus.cc:482] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:38.681233 24201 raft_consensus.cc:504] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.675453 24284 leader_election.cc:288] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:38.678434 23633 leader_election.cc:302] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:38.686326 24188 raft_consensus.cc:2726] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.683833 24249 raft_consensus.cc:482] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:38.617826 23631 leader_election.cc:302] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:38.651126 24281 raft_consensus.cc:2726] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:38:38.627377 24255 consensus_queue.cc:260] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.709054 23737 tablet_bootstrap.cc:492] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:38.710381 23740 ts_tablet_manager.cc:1428] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.244s user 0.024s sys 0.000s
I20260807 13:38:38.712112 23481 raft_consensus.cc:2379] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 1: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:38.717288 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220c24fa0c52459182e1e89c74331f3b" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:38.700103 24249 raft_consensus.cc:504] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:38.708349 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 95360.6us
I20260807 13:38:38.722419 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220c24fa0c52459182e1e89c74331f3b" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:38.729836 23631 leader_election.cc:302] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
W20260807 13:38:38.746104 23533 leader_election.cc:341] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:38.754853 23740 tablet_bootstrap.cc:492] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:38.753873 23739 raft_consensus.cc:348] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.755450 23471 raft_consensus.cc:1261] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260807 13:38:38.757193 23471 pending_rounds.cc:76] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613: Aborting all ops after (but not including) 0
I20260807 13:38:38.721800 24253 leader_election.cc:288] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:38.711481 23633 leader_election.cc:302] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
W20260807 13:38:38.759492 23532 leader_election.cc:341] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:38.760564 23532 leader_election.cc:302] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:38.760818 24274 raft_consensus.cc:2726] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.758265 23471 pending_rounds.cc:97] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260807 13:38:38.761909 23471 raft_consensus.cc:2866] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260807 13:38:38.762600 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 61606.5us
I20260807 13:38:38.755861 23739 raft_consensus.cc:374] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:38.764895 23739 raft_consensus.cc:729] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:38.777299 23532 leader_election.cc:302] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:38.781983 24209 raft_consensus.cc:2726] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:38.771127 23739 consensus_queue.cc:260] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:38.789842 24205 raft_consensus.cc:3037] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:38.789742 24254 raft_consensus.cc:3037] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:38.807405 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:38.809898 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:38.811324 24255 raft_consensus.cc:3037] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:38.788259 24274 raft_consensus.cc:2726] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:38.817723 24201 leader_election.cc:288] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:38.814831 24281 consensus_queue.cc:1035] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260807 13:38:38.839087 23429 leader_election.cc:341] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:38.841027 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:38.795490 24240 raft_consensus.cc:3032] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Stepping down as leader of term 1
W20260807 13:38:38.844333 23533 leader_election.cc:341] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:38.863986 23679 raft_consensus.cc:1261] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260807 13:38:38.866766 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 53372.8us
W20260807 13:38:38.796697 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 67086.6us
I20260807 13:38:38.879783 23739 ts_tablet_manager.cc:1428] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.248s user 0.018s sys 0.000s
I20260807 13:38:38.860271 24240 raft_consensus.cc:729] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:38.878253 23681 raft_consensus.cc:1261] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:38.880198 23633 leader_election.cc:302] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
W20260807 13:38:38.910862 24295 log.cc:924] Time spent T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.080s user 0.003s sys 0.000s
I20260807 13:38:38.949266 23739 tablet_bootstrap.cc:492] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:38.964040 24249 leader_election.cc:288] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:38.970894 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:38.930135 23631 leader_election.cc:302] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:39.028398 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:38.972942 24205 raft_consensus.cc:2726] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 13:38:39.011906 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 57392.4us
I20260807 13:38:39.017953 24273 raft_consensus.cc:482] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:38.912673 24212 consensus_queue.cc:1035] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.105s
I20260807 13:38:38.979420 23580 raft_consensus.cc:1226] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260807 13:38:38.945261 24240 consensus_queue.cc:260] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:39.184751 23740 tablet_bootstrap.cc:700] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1: Time spent opening tablet: real 0.172s user 0.001s sys 0.016s
I20260807 13:38:39.203615 23740 tablet_bootstrap.cc:654] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:39.020505 24274 raft_consensus.cc:482] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:39.073709 23475 raft_consensus.cc:1226] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
W20260807 13:38:39.280025 23676 consensus_meta.cc:287] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.994s user 0.025s sys 0.009s
I20260807 13:38:39.281895 23676 raft_consensus.cc:2454] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:39.073021 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:39.283216 23676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57116 (request call id 231) took 1054 ms. Trace:
I20260807 13:38:39.062876 23679 raft_consensus.cc:1261] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260807 13:38:39.334097 23737 tablet_bootstrap.cc:654] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
W20260807 13:38:39.305778 24204 consensus_meta.cc:287] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 1.033s user 0.028s sys 0.005s
I20260807 13:38:39.304702 24211 raft_consensus.cc:482] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:39.285776 24188 raft_consensus.cc:2741] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260807 13:38:39.067324 24273 raft_consensus.cc:504] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:39.297585 24201 consensus_queue.cc:1035] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.101s
I20260807 13:38:39.286916 24274 raft_consensus.cc:504] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:39.401829 24209 raft_consensus.cc:482] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:39.429761 24205 raft_consensus.cc:482] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:39.296638 23676 rpcz_store.cc:276] 0807 13:38:38.228859 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:38.230064 (+ 1205us) service_pool.cc:227] Handling call
0807 13:38:39.283090 (+1053026us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:39.406401 24211 raft_consensus.cc:504] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:39.482169 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 154522us
W20260807 13:38:39.491452 23532 leader_election.cc:341] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:39.492421 23532 leader_election.cc:302] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:39.460235 24209 raft_consensus.cc:504] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:39.513294 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 669140us
W20260807 13:38:39.490023 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 579749us
I20260807 13:38:39.474416 24205 raft_consensus.cc:504] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:39.503185 24215 raft_consensus.cc:2726] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 13:38:39.522754 24296 log.cc:924] Time spent T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.358s user 0.000s sys 0.004s
W20260807 13:38:39.527489 23469 consensus_meta.cc:287] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 1.082s user 0.047s sys 0.005s
I20260807 13:38:39.520709 24169 raft_consensus.cc:482] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:39.530305 24255 consensus_meta.cc:287] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.718s user 0.039s sys 0.002s
W20260807 13:38:39.550490 24301 log.cc:924] Time spent T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.102s user 0.001s sys 0.001s
I20260807 13:38:39.545629 24227 raft_consensus.cc:482] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:39.562894 24227 raft_consensus.cc:504] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:39.563838 23631 leader_election.cc:302] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:39.581827 23739 tablet_bootstrap.cc:654] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:39.517537 23942 consensus_queue.cc:1046] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.048s
I20260807 13:38:39.532789 24196 raft_consensus.cc:482] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:39.590471 24169 raft_consensus.cc:504] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:39.607856 23532 consensus_peers.cc:487] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 -> Peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Couldn't send request to peer e11cad1eeaf5424c94e51241096f6613. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:38:39.599236 24200 raft_consensus.cc:482] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:39.571213 23469 raft_consensus.cc:2454] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:39.592700 24215 raft_consensus.cc:482] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:39.612725 24200 raft_consensus.cc:504] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:39.599342 23633 leader_election.cc:302] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:39.614872 24200 leader_election.cc:288] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:39.615337 24314 raft_consensus.cc:2726] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:39.606133 24196 raft_consensus.cc:504] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:39.615761 23942 consensus_queue.cc:1035] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:38:39.616082 24314 raft_consensus.cc:2726] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:39.616163 24209 leader_election.cc:288] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:39.615372 24273 leader_election.cc:288] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:39.603560 24227 leader_election.cc:288] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:39.626119 23740 tablet_bootstrap.cc:492] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:39.625948 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:39.626678 23740 ts_tablet_manager.cc:1397] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.873s user 0.018s sys 0.040s
I20260807 13:38:39.628309 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:39.629135 23481 raft_consensus.cc:2454] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:39.603157 24303 raft_consensus.cc:2726] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:39.633028 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:39.626720 23475 raft_consensus.cc:2454] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:39.638015 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:39.638234 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:39.608999 24304 raft_consensus.cc:2726] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:39.626536 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:39.624101 24200 raft_consensus.cc:482] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:39.621073 24310 raft_consensus.cc:482] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:39.629442 23469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 220) took 1350 ms. Trace:
I20260807 13:38:39.662681 23573 raft_consensus.cc:2454] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
W20260807 13:38:39.678548 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 114936us
I20260807 13:38:39.665479 24200 raft_consensus.cc:504] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:39.680716 23631 leader_election.cc:302] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:39.681967 24200 leader_election.cc:288] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:39.682775 23631 leader_election.cc:302] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:39.621479 24215 raft_consensus.cc:504] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:39.656471 24196 leader_election.cc:288] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:39.654443 23471 raft_consensus.cc:2454] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:39.669955 23574 raft_consensus.cc:2454] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:39.656608 23582 raft_consensus.cc:2454] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:39.674309 24169 leader_election.cc:288] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:39.668962 24274 leader_election.cc:288] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:39.711369 24209 raft_consensus.cc:482] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:39.718766 24209 raft_consensus.cc:504] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:39.713424 24318 raft_consensus.cc:2726] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:39.698868 24211 leader_election.cc:288] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:39.724519 24303 consensus_queue.cc:1046] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:39.726135 24215 leader_election.cc:288] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:39.727002 24308 raft_consensus.cc:482] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:39.731385 23737 tablet_bootstrap.cc:492] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:39.698464 24304 raft_consensus.cc:2726] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:39.732275 23737 ts_tablet_manager.cc:1397] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 1.024s user 0.039s sys 0.025s
I20260807 13:38:39.732914 23430 leader_election.cc:302] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:39.736550 23430 leader_election.cc:302] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:39.674773 24310 raft_consensus.cc:504] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:39.736866 24205 leader_election.cc:288] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:39.688519 24315 raft_consensus.cc:482] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:39.741819 23533 leader_election.cc:302] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:39.740335 23430 leader_election.cc:302] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
W20260807 13:38:39.703935 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 114028us
I20260807 13:38:39.669124 23469 rpcz_store.cc:276] 0807 13:38:38.271620 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:38.349797 (+ 78177us) service_pool.cc:227] Handling call
0807 13:38:39.622358 (+1272561us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:39.748373 24169 raft_consensus.cc:2781] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:39.737284 24274 consensus_queue.cc:1046] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260807 13:38:39.732224 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:39.745630 24196 raft_consensus.cc:2781] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:39.774883 24313 consensus_queue.cc:1046] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260807 13:38:39.757344 24169 raft_consensus.cc:482] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:39.746469 24227 raft_consensus.cc:2781] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260807 13:38:39.807428 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 44656.5us
I20260807 13:38:39.784965 24196 raft_consensus.cc:482] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:39.810031 24309 raft_consensus.cc:482] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:39.736459 24308 raft_consensus.cc:504] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:39.853616 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:39.813926 24169 raft_consensus.cc:3037] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:39.855561 23533 leader_election.cc:302] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
W20260807 13:38:39.819453 24254 consensus_meta.cc:287] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 1.019s user 0.025s sys 0.008s
I20260807 13:38:39.863548 23740 raft_consensus.cc:348] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:39.865188 23740 raft_consensus.cc:374] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:39.865520 23740 raft_consensus.cc:729] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:39.815488 24215 raft_consensus.cc:482] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:39.868116 24215 raft_consensus.cc:504] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:39.836846 24196 raft_consensus.cc:3037] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:39.734364 24314 consensus_queue.cc:1046] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260807 13:38:39.817826 24227 raft_consensus.cc:482] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:39.872896 23737 raft_consensus.cc:348] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:39.883190 23737 raft_consensus.cc:374] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:39.884085 23737 raft_consensus.cc:729] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:39.885562 23737 consensus_queue.cc:260] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:39.866571 23740 consensus_queue.cc:260] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:39.876827 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 122434us
I20260807 13:38:39.750659 24315 raft_consensus.cc:504] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:39.924988 24305 raft_consensus.cc:482] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:39.900159 23631 leader_election.cc:302] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters: 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:39.930460 24241 raft_consensus.cc:482] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:39.933449 23737 ts_tablet_manager.cc:1428] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.200s user 0.017s sys 0.001s
W20260807 13:38:39.864312 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 85514.8us
W20260807 13:38:39.967103 24302 log.cc:924] Time spent T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.078s user 0.002s sys 0.000s
I20260807 13:38:39.882546 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:39.985030 24327 raft_consensus.cc:3032] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:39.986294 24327 raft_consensus.cc:729] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:39.875828 24249 consensus_queue.cc:1035] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.083s
W20260807 13:38:39.956743 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 56781us
I20260807 13:38:39.892647 24227 raft_consensus.cc:3037] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:38:40.025027 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 169794us
I20260807 13:38:39.873888 24309 raft_consensus.cc:504] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:39.959005 24313 raft_consensus.cc:3032] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:40.052000 24313 raft_consensus.cc:729] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:39.964285 24273 raft_consensus.cc:482] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:39.964591 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:40.066095 24306 raft_consensus.cc:482] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:40.067202 24298 log.cc:924] Time spent T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.527s user 0.003s sys 0.008s
I20260807 13:38:40.067934 24307 raft_consensus.cc:482] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:39.961833 24241 raft_consensus.cc:504] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:39.982213 24303 raft_consensus.cc:2781] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:40.072167 24323 raft_consensus.cc:482] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:40.072371 23680 raft_consensus.cc:2454] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:40.073263 24273 raft_consensus.cc:504] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.074368 24201 raft_consensus.cc:482] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:40.074486 24315 leader_election.cc:288] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:39.995606 24215 leader_election.cc:288] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:39.926688 24305 raft_consensus.cc:504] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.092207 24310 leader_election.cc:288] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.092339 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:40.095702 24208 raft_consensus.cc:482] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:40.095850 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 100400us
I20260807 13:38:40.082520 24303 raft_consensus.cc:482] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:40.099459 24314 raft_consensus.cc:482] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
W20260807 13:38:40.088095 23430 leader_election.cc:341] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:40.128651 23533 leader_election.cc:302] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:40.072256 24240 raft_consensus.cc:3037] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:40.124223 24320 raft_consensus.cc:2781] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:40.124255 24208 raft_consensus.cc:504] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.082731 24253 raft_consensus.cc:482] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:40.116122 24205 raft_consensus.cc:2726] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:40.140496 23679 raft_consensus.cc:2454] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
I20260807 13:38:40.136633 24303 raft_consensus.cc:3037] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:40.086120 24327 consensus_queue.cc:260] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.212703 24332 raft_consensus.cc:482] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:40.106541 24201 raft_consensus.cc:504] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.171064 24308 leader_election.cc:288] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.121091 24323 raft_consensus.cc:504] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.245572 24330 raft_consensus.cc:482] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:40.230430 24320 raft_consensus.cc:686] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:40.237267 23533 leader_election.cc:302] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:40.157191 24333 raft_consensus.cc:2781] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:40.157455 24253 raft_consensus.cc:504] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
W20260807 13:38:40.245186 23575 consensus_meta.cc:287] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 1.176s user 0.015s sys 0.013s
I20260807 13:38:40.254325 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:40.259398 23671 raft_consensus.cc:2379] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 2: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:40.259464 24309 leader_election.cc:288] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.260676 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:40.262264 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:40.262630 23739 tablet_bootstrap.cc:492] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:40.263207 23739 ts_tablet_manager.cc:1397] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 1.332s user 0.054s sys 0.061s
I20260807 13:38:40.213217 23633 leader_election.cc:302] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:40.107712 24306 raft_consensus.cc:504] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.283174 24306 leader_election.cc:288] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.246243 24330 raft_consensus.cc:504] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.180895 24314 raft_consensus.cc:504] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:40.258163 23571 consensus_meta.cc:287] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.824s user 0.025s sys 0.000s
I20260807 13:38:40.255479 24315 raft_consensus.cc:2781] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:38:40.252696 24333 raft_consensus.cc:482] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:38:40.324364 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 193425us
I20260807 13:38:40.258487 23575 raft_consensus.cc:2454] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:40.325199 23740 ts_tablet_manager.cc:1428] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.698s user 0.011s sys 0.018s
I20260807 13:38:40.295225 24327 raft_consensus.cc:3037] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:40.330096 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:40.247763 24332 raft_consensus.cc:504] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.330807 23582 raft_consensus.cc:2454] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:40.330883 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:40.332549 24332 leader_election.cc:288] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.333293 24332 raft_consensus.cc:482] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:40.333936 24332 raft_consensus.cc:504] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.323431 23571 raft_consensus.cc:2454] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:40.209683 24313 consensus_queue.cc:260] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:38:40.339522 24204 raft_consensus.cc:482] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:40.339437 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:40.340219 23574 raft_consensus.cc:2454] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:40.340312 24313 raft_consensus.cc:3037] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:40.340101 24204 raft_consensus.cc:504] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.135785 24307 raft_consensus.cc:504] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:40.326725 23740 ts_tablet_manager.cc:1460] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1: Tablet startup took 699ms
I20260807 13:38:40.269316 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:40.320771 24274 raft_consensus.cc:2726] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:40.320039 24326 raft_consensus.cc:482] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:40.348047 24208 leader_election.cc:288] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.347930 23739 raft_consensus.cc:348] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.351199 23481 raft_consensus.cc:1226] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:40.361868 23739 raft_consensus.cc:374] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:40.322618 24315 raft_consensus.cc:482] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:40.324357 24333 raft_consensus.cc:3037] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:40.338783 24330 leader_election.cc:288] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:40.362316 23739 raft_consensus.cc:729] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:40.336160 24273 leader_election.cc:288] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.344040 24241 leader_election.cc:288] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:40.342218 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 167816us
I20260807 13:38:40.360083 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:40.367574 23739 consensus_queue.cc:260] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:40.345099 23740 ts_tablet_manager.cc:1462] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1: Trace:
0807 13:38:28.305644 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:28.312259 (+ 6615us) service_pool.cc:227] Handling call
0807 13:38:28.314298 (+ 2039us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:38:28.314407 (+ 109us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:38:28.488355 (+173948us) tablet_metadata.cc:641] Metadata flushed
0807 13:38:28.601347 (+112992us) tablet_replica.cc:205] Creating consensus instance
0807 13:38:28.601814 (+ 467us) inbound_call.cc:173] Queueing success response
0807 13:38:38.729322 (+10127508us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0807 13:38:39.627021 (+897699us) ts_tablet_manager.cc:1429] Starting tablet replica
0807 13:38:39.778180 (+151159us) tablet_replica.cc:259] Starting instrumentation
0807 13:38:39.786108 (+ 7928us) tablet_replica.cc:278] Starting consensus
Metrics: {"mutex_wait_us":57154,"raft.queue_time_us":109330,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":166,"tablet-open.queue_time_us":10112773,"thread_start_us":344336,"threads_started":1}
I20260807 13:38:40.365340 24315 raft_consensus.cc:3037] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:40.387112 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:40.388048 23671 raft_consensus.cc:2454] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:40.347564 24340 raft_consensus.cc:482] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:40.386019 23740 tablet_bootstrap.cc:492] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:40.385753 24201 leader_election.cc:288] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.392107 24206 raft_consensus.cc:482] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:40.392757 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:40.370626 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "608f7e63bc4648e0890e5f601c52736c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:40.395632 23533 leader_election.cc:302] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
W20260807 13:38:40.396188 23575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 181) took 1631 ms (client timeout 1562 ms). Trace:
W20260807 13:38:40.398726 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 67675.1us
I20260807 13:38:40.415706 23739 ts_tablet_manager.cc:1428] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.152s user 0.008s sys 0.002s
W20260807 13:38:40.451584 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 56047.6us
I20260807 13:38:40.455178 23430 leader_election.cc:302] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
W20260807 13:38:40.397178 24169 consensus_meta.cc:287] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.512s user 0.006s sys 0.010s
I20260807 13:38:40.381772 24330 raft_consensus.cc:482] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:40.416962 24339 raft_consensus.cc:482] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:40.398087 24253 leader_election.cc:288] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.398340 24332 leader_election.cc:288] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.416787 24323 leader_election.cc:288] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.397254 24304 raft_consensus.cc:3032] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:40.434425 23478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 210) took 2275 ms. Trace:
I20260807 13:38:40.396517 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:40.450239 24241 raft_consensus.cc:482] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:40.458314 24201 raft_consensus.cc:2781] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:40.455295 24208 raft_consensus.cc:482] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:40.464968 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 108243us
I20260807 13:38:40.467968 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:40.360934 24320 consensus_queue.cc:237] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.369120 24326 raft_consensus.cc:504] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.397426 24338 raft_consensus.cc:482] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:40.463876 24169 raft_consensus.cc:504] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.462106 24314 leader_election.cc:288] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:40.403393 23633 leader_election.cc:302] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:40.453056 24206 raft_consensus.cc:504] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.469105 24339 raft_consensus.cc:504] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.477342 23533 leader_election.cc:302] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:40.465597 24243 raft_consensus.cc:482] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:40.475687 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:40.448863 23575 rpcz_store.cc:269] 0807 13:38:38.765255 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:38.767759 (+ 2504us) service_pool.cc:227] Handling call
0807 13:38:40.395985 (+1628226us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b54003f11d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:40.396098 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":566453120}
I20260807 13:38:40.555419 24260 raft_consensus.cc:2781] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260807 13:38:40.598642 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 121421us
I20260807 13:38:40.603029 24260 raft_consensus.cc:482] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:40.603623 24260 raft_consensus.cc:3037] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:40.474702 24201 raft_consensus.cc:482] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:38:40.600534 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 145455us
I20260807 13:38:40.467548 24304 raft_consensus.cc:729] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:40.470350 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:40.509332 24323 raft_consensus.cc:482] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:40.463515 24349 raft_consensus.cc:482] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
W20260807 13:38:40.628465 24196 consensus_meta.cc:287] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.731s user 0.015s sys 0.001s
I20260807 13:38:40.629096 24196 raft_consensus.cc:504] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.632136 24196 leader_election.cc:288] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.631832 24323 raft_consensus.cc:504] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.634037 24323 leader_election.cc:288] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.634521 24209 leader_election.cc:288] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.473562 23671 raft_consensus.cc:2454] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:40.636396 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:40.636925 24334 raft_consensus.cc:2781] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:40.636243 23475 raft_consensus.cc:1226] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:40.474422 24332 raft_consensus.cc:482] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:40.602200 23684 raft_consensus.cc:2454] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:40.589265 24240 raft_consensus.cc:482] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:40.589082 24239 raft_consensus.cc:482] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:40.588285 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:40.464275 24227 raft_consensus.cc:504] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.463583 24330 raft_consensus.cc:504] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.608754 23430 leader_election.cc:302] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:40.518714 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:40.524756 23676 raft_consensus.cc:2454] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:40.639659 23533 leader_election.cc:302] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:40.460546 24340 raft_consensus.cc:504] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.606613 24243 raft_consensus.cc:504] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.644383 24240 raft_consensus.cc:504] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.559365 24307 leader_election.cc:288] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.645529 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:40.608603 24201 raft_consensus.cc:3037] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:40.611492 24314 raft_consensus.cc:2781] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:38:40.559531 24348 raft_consensus.cc:482] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:40.521996 24208 raft_consensus.cc:504] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.637517 24334 raft_consensus.cc:482] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:40.476765 24315 raft_consensus.cc:504] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.656467 23533 leader_election.cc:302] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:40.637233 24347 raft_consensus.cc:482] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:40.478477 24241 raft_consensus.cc:504] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.655406 23684 raft_consensus.cc:2454] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:40.649158 23681 raft_consensus.cc:2454] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:40.660292 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "608f7e63bc4648e0890e5f601c52736c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:40.660580 24334 raft_consensus.cc:3037] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:40.665158 23674 raft_consensus.cc:2454] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:40.665346 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:40.663949 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:40.642344 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 252015us
I20260807 13:38:40.666666 23533 leader_election.cc:302] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
W20260807 13:38:40.664206 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 55585.6us
I20260807 13:38:40.666334 23684 raft_consensus.cc:2454] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:40.669283 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:40.644201 23581 raft_consensus.cc:2454] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:40.657579 24209 raft_consensus.cc:2781] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:40.671406 23533 leader_election.cc:302] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:40.673920 24212 raft_consensus.cc:2781] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:40.674012 24190 raft_consensus.cc:3032] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:40.674993 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:40.599993 24338 raft_consensus.cc:504] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.646319 24332 raft_consensus.cc:504] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.682220 24209 raft_consensus.cc:482] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:40.646697 24239 raft_consensus.cc:504] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.685647 24190 raft_consensus.cc:729] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:40.689291 24360 raft_consensus.cc:482] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:40.690086 23737 tablet_bootstrap.cc:492] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:40.670413 24323 raft_consensus.cc:2781] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:40.691118 23430 leader_election.cc:302] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:40.663866 24314 raft_consensus.cc:686] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:40.692363 23533 leader_election.cc:302] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:40.667824 24307 raft_consensus.cc:2781] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:40.682360 24303 raft_consensus.cc:504] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.697006 23572 raft_consensus.cc:2454] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:40.685233 24212 raft_consensus.cc:482] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:40.684377 24206 leader_election.cc:288] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.697218 23578 raft_consensus.cc:2379] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 5: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:40.700019 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:40.712124 23677 raft_consensus.cc:2454] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:40.712473 24339 leader_election.cc:288] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.713128 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:40.683250 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:40.698148 24323 raft_consensus.cc:482] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:40.692654 24209 raft_consensus.cc:3037] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:40.695068 24309 raft_consensus.cc:2781] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:40.711275 24240 leader_election.cc:288] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.670104 23681 raft_consensus.cc:2454] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
W20260807 13:38:40.720541 23533 leader_election.cc:341] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:38:40.738524 23407 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:38:40.648479 24349 raft_consensus.cc:504] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.723048 24326 leader_election.cc:288] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:40.702893 24310 raft_consensus.cc:2781] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:40.675926 23633 leader_election.cc:302] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:40.724386 24169 leader_election.cc:288] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.660985 24304 consensus_queue.cc:260] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.708056 24212 raft_consensus.cc:3037] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:40.756062 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:40.756737 23580 raft_consensus.cc:3037] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:40.757570 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:40.727192 24332 leader_election.cc:288] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.728935 24303 leader_election.cc:288] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:40.760152 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:40.729666 24330 leader_election.cc:288] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:40.725325 23430 leader_election.cc:302] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:40.706075 24356 raft_consensus.cc:482] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:40.732996 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:40.725497 24323 raft_consensus.cc:3037] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:40.711468 24362 raft_consensus.cc:2781] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:40.700909 24307 raft_consensus.cc:482] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:38:40.751847 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 76021us
I20260807 13:38:40.731383 24309 raft_consensus.cc:482] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:40.774588 24349 leader_election.cc:288] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.754205 24326 raft_consensus.cc:2781] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:38:40.776068 24326 raft_consensus.cc:686] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:40.777302 24326 consensus_queue.cc:237] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.468024 23478 rpcz_store.cc:276] 0807 13:38:38.158793 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:38.159022 (+ 229us) service_pool.cc:227] Handling call
0807 13:38:38.590894 (+431872us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:38.864029 (+273135us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:38.864118 (+ 89us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:38.865391 (+ 1273us) log.cc:842] Serialized 26 byte log entry
0807 13:38:39.164463 (+299072us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:39.269434 (+104971us) log.cc:842] Serialized 14 byte log entry
0807 13:38:39.503504 (+234070us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:39.520866 (+ 17362us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:39.602639 (+ 81773us) raft_consensus.cc:1671] finished
0807 13:38:39.602662 (+ 23us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:40.434177 (+831515us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b5400292f50. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ea09 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:40.434334 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":129743,"prepare.queue_time_us":1454,"prepare.run_cpu_time_us":499,"prepare.run_wall_time_us":10116,"raft.queue_time_us":108023,"raft.run_cpu_time_us":995,"raft.run_wall_time_us":33570,"spinlock_wait_cycles":964422144,"thread_start_us":421148,"threads_started":2,"wal-append.queue_time_us":490901,"wal-append.run_cpu_time_us":6803,"wal-append.run_wall_time_us":1237226}
I20260807 13:38:40.754890 24243 leader_election.cc:288] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.755355 24304 raft_consensus.cc:3037] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:38:40.760401 24322 log.cc:924] Time spent T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.869s user 0.006s sys 0.013s
I20260807 13:38:40.729518 24227 leader_election.cc:288] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.700815 24360 raft_consensus.cc:504] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.759413 24340 leader_election.cc:288] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.668179 24348 raft_consensus.cc:504] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.761045 23679 raft_consensus.cc:2379] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 2: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:40.746253 24310 raft_consensus.cc:482] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:40.782371 24309 raft_consensus.cc:3037] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:40.781804 24208 leader_election.cc:288] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.780169 24356 raft_consensus.cc:504] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.753383 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:40.670346 24347 raft_consensus.cc:504] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.770049 24169 raft_consensus.cc:2781] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:40.791121 24239 leader_election.cc:288] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.814023 23672 raft_consensus.cc:2454] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:40.791332 24315 leader_election.cc:288] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.783234 24307 raft_consensus.cc:3037] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:40.770920 23430 leader_election.cc:302] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
W20260807 13:38:40.824079 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 53281.6us
I20260807 13:38:40.825778 24338 leader_election.cc:288] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.809460 24310 raft_consensus.cc:3037] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:40.818194 24169 raft_consensus.cc:482] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:40.819268 24241 leader_election.cc:288] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.782091 24190 consensus_queue.cc:260] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.829303 24239 raft_consensus.cc:2781] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:40.806948 24362 raft_consensus.cc:686] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:40.770566 24314 consensus_queue.cc:237] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.862690 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:40.845449 24169 raft_consensus.cc:3037] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:40.844003 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:40.868625 23533 leader_election.cc:302] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:40.874802 24347 leader_election.cc:288] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.858500 24239 raft_consensus.cc:482] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:40.879336 24360 leader_election.cc:288] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.867741 24190 raft_consensus.cc:3037] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:40.887374 24348 leader_election.cc:288] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.880766 24208 raft_consensus.cc:2781] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:40.869158 23580 raft_consensus.cc:2454] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:40.883561 24239 raft_consensus.cc:3037] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:38:40.880746 24333 consensus_meta.cc:287] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.507s user 0.010s sys 0.003s
I20260807 13:38:40.908121 23679 raft_consensus.cc:2396] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:38:40.895483 24208 raft_consensus.cc:482] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:40.920442 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:40.923776 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 1.29205e+06us
I20260807 13:38:40.928730 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "608f7e63bc4648e0890e5f601c52736c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:40.934047 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:40.934353 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:40.935182 23469 raft_consensus.cc:2454] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:40.935571 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:40.936264 23470 raft_consensus.cc:2454] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:40.935307 23473 raft_consensus.cc:2379] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 2: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:40.914201 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:40.937942 23580 raft_consensus.cc:2454] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:40.923116 24208 raft_consensus.cc:3037] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:40.938880 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:40.941460 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:40.942101 23481 raft_consensus.cc:2454] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
I20260807 13:38:40.950878 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:40.911209 24333 raft_consensus.cc:504] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.951807 23481 raft_consensus.cc:2454] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:40.952096 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:40.947705 24249 raft_consensus.cc:482] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:40.954010 24356 leader_election.cc:288] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.952916 24249 raft_consensus.cc:504] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.954339 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:40.954640 24333 leader_election.cc:288] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.955931 24249 leader_election.cc:288] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.955998 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:40.942556 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:40.949893 24205 raft_consensus.cc:482] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:40.960590 24205 raft_consensus.cc:504] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.958357 24212 raft_consensus.cc:504] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.964251 24212 leader_election.cc:288] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:40.916204 24334 raft_consensus.cc:504] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:40.966197 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:41.003456 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:41.004885 24209 raft_consensus.cc:504] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.007303 24209 leader_election.cc:288] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:41.007629 23737 tablet_bootstrap.cc:654] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:41.008025 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:41.008230 23571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 121) took 3406 ms (client timeout 1572 ms). Trace:
W20260807 13:38:41.012190 23571 rpcz_store.cc:269] 0807 13:38:37.601755 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:37.611362 (+ 9607us) service_pool.cc:227] Handling call
0807 13:38:41.008016 (+3396654us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54004353d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:41.008137 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3883789696}
I20260807 13:38:41.013500 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:41.014856 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4996c3c52ccc41b9a8da11ca747a8e6a" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:41.004911 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:41.016067 23574 raft_consensus.cc:2354] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 for earlier term 2. Current term is 3.
I20260807 13:38:41.016884 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:41.009820 24204 leader_election.cc:288] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:41.010462 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:41.010771 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:41.018277 23481 raft_consensus.cc:2454] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:41.020686 23578 raft_consensus.cc:2454] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:40.972044 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:41.032840 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 418507us
W20260807 13:38:41.035095 23429 leader_election.cc:341] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:41.038749 23429 leader_election.cc:302] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:41.040443 23429 leader_election.cc:302] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters: 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:41.014870 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:41.017565 23574 raft_consensus.cc:2454] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:41.050356 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:41.054044 23572 raft_consensus.cc:2379] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 3: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:41.054731 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:41.055231 23572 raft_consensus.cc:1226] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 2 LEADER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:41.055423 23472 raft_consensus.cc:2454] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:41.056550 23740 tablet_bootstrap.cc:654] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:41.023895 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:41.042200 24281 raft_consensus.cc:2726] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:41.066181 23532 leader_election.cc:302] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:40.944028 24362 consensus_queue.cc:237] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:41.072525 23631 leader_election.cc:341] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:41.022632 24260 raft_consensus.cc:504] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.042593 24201 raft_consensus.cc:504] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.077760 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:41.079347 23481 raft_consensus.cc:3037] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:41.085284 23675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 247) took 1269 ms. Trace:
I20260807 13:38:41.078737 24241 raft_consensus.cc:482] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:41.085691 23675 rpcz_store.cc:276] 0807 13:38:39.819255 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:39.841582 (+ 22327us) service_pool.cc:227] Handling call
0807 13:38:41.075021 (+1233439us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b5800004298. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:38:41.082820 (+ 7799us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:41.084912 (+ 2092us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:41.084948 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:41.084988 (+ 40us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:41.085022 (+ 34us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:41.085078 (+ 56us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:41.085190 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":10810240}
I20260807 13:38:41.075377 24279 raft_consensus.cc:482] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:41.088287 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:41.104557 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:41.105365 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:41.104748 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:41.078974 24200 raft_consensus.cc:2741] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260807 13:38:41.129873 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:41.129333 23684 raft_consensus.cc:2454] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:41.083338 24348 raft_consensus.cc:482] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:41.147779 23633 connection.cc:232] RPC call timeout handler was delayed by -2.0846433250699192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
I20260807 13:38:41.154430 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:41.145473 24330 raft_consensus.cc:482] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:41.155395 23479 raft_consensus.cc:2379] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 2: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:41.155736 24330 raft_consensus.cc:504] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.156481 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:41.157105 23479 raft_consensus.cc:3037] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:41.090265 24273 raft_consensus.cc:2781] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:41.158133 24330 leader_election.cc:288] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:41.148051 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:41.147853 24334 leader_election.cc:288] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:41.159160 23473 raft_consensus.cc:2379] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 2: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:41.160017 23577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 189) took 1561 ms. Trace:
I20260807 13:38:41.160226 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:41.160897 23473 raft_consensus.cc:3037] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:41.086701 24205 leader_election.cc:288] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:41.088977 24241 raft_consensus.cc:504] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.160449 23577 rpcz_store.cc:276] 0807 13:38:39.598833 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:39.606920 (+ 8087us) service_pool.cc:227] Handling call
0807 13:38:40.470282 (+863362us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:38:40.553701 (+ 83419us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:40.739293 (+185592us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:40.741081 (+ 1788us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:40.746088 (+ 5007us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:40.749302 (+ 3214us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:41.159718 (+410416us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400377154. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:41.159790 (+ 72us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:41.159928 (+ 138us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":396961920}
I20260807 13:38:41.165617 24241 leader_election.cc:288] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:41.129405 24279 raft_consensus.cc:504] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.150157 24260 leader_election.cc:288] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:41.151777 23631 leader_election.cc:341] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:41.081459 24326 consensus_queue.cc:1046] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.072s
I20260807 13:38:41.172700 23572 raft_consensus.cc:1226] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:41.173031 24309 raft_consensus.cc:504] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:41.174424 24361 log.cc:924] Time spent T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.106s user 0.000s sys 0.000s
I20260807 13:38:41.157333 24305 leader_election.cc:288] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:41.168524 24279 leader_election.cc:288] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:41.176100 24273 raft_consensus.cc:482] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:41.146643 23481 raft_consensus.cc:2454] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 5.
I20260807 13:38:41.258144 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:41.258352 23684 raft_consensus.cc:1226] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:41.258955 23481 raft_consensus.cc:2454] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:41.179077 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220c24fa0c52459182e1e89c74331f3b" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:41.179355 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
W20260807 13:38:41.179838 23532 leader_election.cc:341] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:41.182948 23346 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41390 (request call id 69) took 3105 ms. Trace:
I20260807 13:38:41.185339 23430 leader_election.cc:302] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:41.170141 23578 raft_consensus.cc:1226] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:41.239671 23475 raft_consensus.cc:2379] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 2: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
W20260807 13:38:41.288678 24363 log.cc:924] Time spent T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.126s user 0.000s sys 0.000s
I20260807 13:38:41.288859 24211 consensus_queue.cc:1046] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:41.290211 24211 raft_consensus.cc:3032] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:41.290373 23677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 192) took 1194 ms. Trace:
I20260807 13:38:41.290766 24211 raft_consensus.cc:729] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
W20260807 13:38:41.293090 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 107859us
I20260807 13:38:41.294662 23430 leader_election.cc:302] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
W20260807 13:38:41.272377 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 117480us
W20260807 13:38:41.274824 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 98926.2us
I20260807 13:38:41.169011 24348 raft_consensus.cc:504] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.276782 23680 raft_consensus.cc:2454] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:41.273121 23346 rpcz_store.cc:276] 0807 13:38:38.077348 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:38.077569 (+ 221us) service_pool.cc:227] Handling call
0807 13:38:41.182867 (+3105298us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:38:39.421620 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:38:39.568501 (+146881us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:38:39.568601 (+ 100us) write_op.cc:435] Acquired schema lock
0807 13:38:39.568640 (+ 39us) tablet.cc:660] Decoding operations
0807 13:38:39.569666 (+ 1026us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:38:39.569925 (+ 259us) write_op.cc:641] Partition lock acquired for write op
0807 13:38:39.569996 (+ 71us) tablet.cc:683] Acquiring locks for 2 operations
0807 13:38:39.615498 (+ 45502us) tablet.cc:699] Row locks acquired
0807 13:38:39.615542 (+ 44us) write_op.cc:260] PREPARE: finished
0807 13:38:39.617340 (+ 1798us) write_op.cc:270] Start()
0807 13:38:39.617618 (+ 278us) write_op.cc:276] Timestamp: P: 1786109919617162 usec, L: 0
0807 13:38:39.617688 (+ 70us) op_driver.cc:331] REPLICATION: starting
0807 13:38:39.627486 (+ 9798us) log.cc:842] Serialized 916 byte log entry
0807 13:38:40.329723 (+702237us) op_driver.cc:444] REPLICATION: finished
0807 13:38:40.383170 (+ 53447us) write_op.cc:301] APPLY: starting
0807 13:38:40.383289 (+ 119us) tablet.cc:1365] starting BulkCheckPresence
0807 13:38:40.383403 (+ 114us) tablet.cc:1368] finished BulkCheckPresence
0807 13:38:40.383535 (+ 132us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:38:40.383982 (+ 447us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:38:40.384176 (+ 194us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0807 13:38:40.384203 (+ 27us) write_op.cc:312] APPLY: finished
0807 13:38:40.384463 (+ 260us) log.cc:842] Serialized 28 byte log entry
0807 13:38:40.384635 (+ 172us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:38:40.384726 (+ 91us) write_op.cc:454] Released schema lock
0807 13:38:40.384780 (+ 54us) write_op.cc:341] FINISH: Updating metrics
0807 13:38:40.385052 (+ 272us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:38:40.385081 (+ 29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":53157,"apply.run_cpu_time_us":2181,"apply.run_wall_time_us":2180,"num_ops":2,"prepare.queue_time_us":601905,"prepare.run_cpu_time_us":18197,"prepare.run_wall_time_us":533085,"raft.queue_time_us":201478,"raft.run_cpu_time_us":14893,"raft.run_wall_time_us":39042,"replication_time_us":711930,"thread_start_us":802732,"threads_started":4,"wal-append.queue_time_us":331402}]]}
I20260807 13:38:41.278239 24309 leader_election.cc:288] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:41.279212 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:41.298488 23532 leader_election.cc:302] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
W20260807 13:38:41.342971 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 44563.3us
I20260807 13:38:41.247948 24303 raft_consensus.cc:482] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:41.260177 24273 raft_consensus.cc:3037] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:41.343633 23532 leader_election.cc:302] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:41.341841 23430 leader_election.cc:398] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Vote denied by peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363) with higher term. Message: Invalid argument: T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 for earlier term 2. Current term is 3.
I20260807 13:38:41.347877 23430 leader_election.cc:401] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 13:38:41.344676 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:41.348299 24309 raft_consensus.cc:2781] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:41.348457 23684 raft_consensus.cc:3037] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:41.348758 24309 raft_consensus.cc:482] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:41.350011 24309 raft_consensus.cc:3037] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:38:41.350910 23532 leader_election.cc:341] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:41.351343 23532 leader_election.cc:302] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:41.352536 24204 raft_consensus.cc:2726] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:41.356688 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:41.362954 23684 raft_consensus.cc:2454] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:41.387003 23481 raft_consensus.cc:3037] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:41.388661 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:41.300026 23580 raft_consensus.cc:1226] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:41.390550 23684 raft_consensus.cc:3037] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 3
I20260807 13:38:41.330742 24279 raft_consensus.cc:2781] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:38:41.304512 24304 raft_consensus.cc:482] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
W20260807 13:38:41.340196 24323 consensus_meta.cc:287] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.558s user 0.004s sys 0.008s
I20260807 13:38:41.397019 23533 leader_election.cc:302] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
W20260807 13:38:41.479923 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 83021.4us
W20260807 13:38:41.394002 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 96402.7us
I20260807 13:38:41.481534 23430 leader_election.cc:302] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
W20260807 13:38:41.482882 23430 leader_election.cc:341] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:41.345896 24326 raft_consensus.cc:482] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:41.452630 23681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 262) took 1099 ms. Trace:
I20260807 13:38:41.431713 24362 raft_consensus.cc:482] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:41.456326 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:41.386739 24211 consensus_queue.cc:260] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:41.459340 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 69108.6us
I20260807 13:38:41.290977 23677 rpcz_store.cc:276] 0807 13:38:40.119266 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:40.715025 (+595759us) service_pool.cc:227] Handling call
0807 13:38:40.715329 (+ 304us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:40.722452 (+ 7123us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:40.722493 (+ 41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:40.723041 (+ 548us) log.cc:842] Serialized 26 byte log entry
0807 13:38:41.052387 (+329346us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:41.059527 (+ 7140us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:41.063119 (+ 3592us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:41.290034 (+226915us) raft_consensus.cc:1671] finished
0807 13:38:41.290075 (+ 41us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:41.290280 (+ 205us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":161,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":140,"thread_start_us":324188,"threads_started":1,"wal-append.queue_time_us":349849}
I20260807 13:38:41.460013 24279 raft_consensus.cc:686] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:41.461108 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:41.462170 24348 leader_election.cc:288] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:41.391053 24201 leader_election.cc:288] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:41.343743 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:41.539582 23430 leader_election.cc:302] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:41.455190 24309 raft_consensus.cc:504] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.466691 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:41.470117 24169 consensus_meta.cc:287] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.593s user 0.007s sys 0.002s
I20260807 13:38:41.525848 24200 raft_consensus.cc:2781] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:41.502951 23684 raft_consensus.cc:2454] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:41.337041 24305 raft_consensus.cc:2781] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:41.299227 23674 raft_consensus.cc:3037] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 3
I20260807 13:38:41.356163 24320 raft_consensus.cc:2781] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260807 13:38:41.480746 23533 leader_election.cc:341] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:41.465693 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:41.474123 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "608f7e63bc4648e0890e5f601c52736c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:41.528931 24241 raft_consensus.cc:2781] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:41.388479 24303 raft_consensus.cc:504] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.522403 24304 raft_consensus.cc:504] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.556605 24200 raft_consensus.cc:686] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
W20260807 13:38:41.566826 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 86128.8us
W20260807 13:38:41.569808 24378 log.cc:924] Time spent T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.102s user 0.001s sys 0.000s
I20260807 13:38:41.570734 23740 tablet_bootstrap.cc:492] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:41.584843 23740 ts_tablet_manager.cc:1397] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 1.199s user 0.062s sys 0.081s
I20260807 13:38:41.557322 24305 raft_consensus.cc:482] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:41.367148 24239 raft_consensus.cc:504] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:38:41.564594 23571 raft_consensus.cc:2454] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:41.545378 24360 raft_consensus.cc:2781] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:41.527964 24323 raft_consensus.cc:504] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.585465 23533 leader_election.cc:302] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:41.357095 24208 raft_consensus.cc:504] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.532542 24362 raft_consensus.cc:504] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.531553 24326 raft_consensus.cc:504] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.549873 23478 raft_consensus.cc:2454] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:41.566483 24320 raft_consensus.cc:482] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
W20260807 13:38:41.594552 23582 consensus_meta.cc:287] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.639s user 0.012s sys 0.000s
I20260807 13:38:41.575210 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:41.574311 24211 raft_consensus.cc:3037] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:41.581115 24241 raft_consensus.cc:482] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:41.590528 24305 raft_consensus.cc:3037] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:41.588102 24201 raft_consensus.cc:482] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:41.557298 24169 raft_consensus.cc:504] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.594273 24360 raft_consensus.cc:482] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:41.597469 24205 raft_consensus.cc:2781] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:41.588775 23679 raft_consensus.cc:2454] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:41.618396 24241 raft_consensus.cc:3037] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:41.628140 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:41.629453 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:41.630632 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:41.631268 23571 raft_consensus.cc:2454] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:41.633772 23481 raft_consensus.cc:2454] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:41.619127 23574 raft_consensus.cc:2379] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 1: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:41.637573 23740 raft_consensus.cc:348] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.638784 23740 raft_consensus.cc:374] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:41.642105 23480 raft_consensus.cc:2354] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3.
I20260807 13:38:41.616917 24320 raft_consensus.cc:3037] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:41.639345 23740 raft_consensus.cc:729] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:41.645047 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:41.646201 23481 raft_consensus.cc:3037] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:41.605412 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:41.649667 23533 leader_election.cc:302] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:41.646459 23740 consensus_queue.cc:260] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.625617 24360 raft_consensus.cc:3037] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:41.641637 24169 leader_election.cc:288] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:41.625079 24279 consensus_queue.cc:237] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.624395 24201 raft_consensus.cc:504] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.620548 23582 raft_consensus.cc:2454] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:41.660382 23737 tablet_bootstrap.cc:492] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:41.678318 23737 ts_tablet_manager.cc:1397] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.995s user 0.041s sys 0.024s
I20260807 13:38:41.634176 23469 raft_consensus.cc:3037] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:41.523422 23681 rpcz_store.cc:276] 0807 13:38:40.353550 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:40.766089 (+412539us) service_pool.cc:227] Handling call
0807 13:38:40.796286 (+ 30197us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:40.827562 (+ 31276us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:40.829929 (+ 2367us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:40.866500 (+ 36571us) log.cc:842] Serialized 26 byte log entry
0807 13:38:41.071930 (+205430us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:38:41.075967 (+ 4037us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:41.079813 (+ 3846us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:41.452330 (+372517us) raft_consensus.cc:1671] finished
0807 13:38:41.452370 (+ 40us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:41.452556 (+ 186us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2400,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":10531,"thread_start_us":181200,"threads_started":1,"wal-append.queue_time_us":273112}
I20260807 13:38:41.659031 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:41.684800 23677 raft_consensus.cc:2379] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 2: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:41.685675 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:41.686286 23677 raft_consensus.cc:2454] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
W20260807 13:38:41.686779 24190 consensus_meta.cc:287] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.794s user 0.009s sys 0.002s
I20260807 13:38:41.687237 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:41.657172 24315 raft_consensus.cc:2781] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:41.675330 23580 raft_consensus.cc:2454] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
W20260807 13:38:41.689949 24307 consensus_meta.cc:287] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.856s user 0.013s sys 0.001s
I20260807 13:38:41.652155 23581 raft_consensus.cc:2379] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 3: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:41.691915 23429 leader_election.cc:302] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:41.643635 24205 raft_consensus.cc:686] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
W20260807 13:38:41.682284 24310 consensus_meta.cc:287] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.839s user 0.014s sys 0.000s
I20260807 13:38:41.651345 23479 raft_consensus.cc:2454] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:41.674357 24326 leader_election.cc:288] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:41.666321 24208 leader_election.cc:288] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:41.664964 24304 leader_election.cc:288] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:41.658551 24323 leader_election.cc:288] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:41.667696 24362 leader_election.cc:288] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:41.669250 24239 leader_election.cc:288] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:41.676167 24303 leader_election.cc:288] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
W20260807 13:38:41.703730 23429 leader_election.cc:341] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:41.704993 24306 raft_consensus.cc:2726] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:41.704494 23674 raft_consensus.cc:2454] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:41.658236 24309 leader_election.cc:288] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:41.679713 23676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57116 (request call id 254) took 1803 ms (client timeout 1856 ms). Trace:
I20260807 13:38:41.668061 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:41.693765 24315 raft_consensus.cc:482] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:41.708415 23740 ts_tablet_manager.cc:1428] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.123s user 0.002s sys 0.006s
I20260807 13:38:41.653018 24200 consensus_queue.cc:237] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.756577 23631 leader_election.cc:302] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:41.720309 23672 raft_consensus.cc:1261] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260807 13:38:41.776906 23533 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.69.3:36765 timed out after 1.856s (SENT) [suppressed 10 similar messages]
I20260807 13:38:41.716756 24364 raft_consensus.cc:2726] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363) with higher term. Message: Invalid argument: T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 for earlier term 2. Current term is 3.
W20260807 13:38:41.757411 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 216684us
I20260807 13:38:41.720995 24326 raft_consensus.cc:482] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:41.723917 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:41.698884 24307 raft_consensus.cc:504] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.783766 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:41.764061 24169 raft_consensus.cc:482] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:41.784535 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:41.783104 23737 raft_consensus.cc:348] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.705221 24310 raft_consensus.cc:504] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:41.886643 23480 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 126) took 1535 ms (client timeout 1749 ms). Trace:
I20260807 13:38:41.887153 24310 leader_election.cc:288] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:41.876190 24309 raft_consensus.cc:482] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:41.888921 24307 leader_election.cc:288] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:41.888711 24309 raft_consensus.cc:504] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.890934 24309 leader_election.cc:288] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:41.790592 23481 raft_consensus.cc:2454] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:41.892254 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:41.892275 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220c24fa0c52459182e1e89c74331f3b" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:41.893049 23573 raft_consensus.cc:2454] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:41.893642 23573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 218) took 1151 ms. Trace:
I20260807 13:38:41.893888 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:41.894043 23573 rpcz_store.cc:276] 0807 13:38:40.742687 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:40.743764 (+ 1077us) service_pool.cc:227] Handling call
0807 13:38:41.862149 (+1118385us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:41.893576 (+ 31427us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5495168}
I20260807 13:38:41.894559 23481 raft_consensus.cc:2454] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
W20260807 13:38:41.895855 23680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57116 (request call id 257) took 1806 ms (client timeout 1829 ms). Trace:
W20260807 13:38:41.896289 23680 rpcz_store.cc:269] 0807 13:38:40.089524 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:40.669909 (+580385us) service_pool.cc:227] Handling call
0807 13:38:41.895678 (+1225769us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b54003458d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:41.895789 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1279600512}
W20260807 13:38:41.887060 23480 rpcz_store.cc:269] 0807 13:38:40.351771 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:40.354617 (+ 2846us) service_pool.cc:227] Handling call
0807 13:38:41.010354 (+655737us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b5800003398. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ffbce 000000000034aea9 00007fc69cf2ba30 00007fc69cff17b4 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:41.886380 (+876026us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b54000b9ad4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:41.886577 (+ 197us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1474288256}
I20260807 13:38:41.899060 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:41.899259 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:41.900115 23739 tablet_bootstrap.cc:492] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:41.901039 24360 raft_consensus.cc:504] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.791190 23631 leader_election.cc:302] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:41.792852 23429 leader_election.cc:302] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
W20260807 13:38:41.904246 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 111497us
W20260807 13:38:41.793495 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 193093us
I20260807 13:38:41.903085 24360 leader_election.cc:288] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:41.845089 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:41.848866 23479 raft_consensus.cc:2396] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:38:41.797756 24326 raft_consensus.cc:504] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.916294 24330 raft_consensus.cc:3032] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:41.916765 24330 raft_consensus.cc:729] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:41.917716 24326 leader_election.cc:288] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:41.797163 23430 leader_election.cc:302] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:41.917603 24330 consensus_queue.cc:260] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:41.918527 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 121446us
I20260807 13:38:41.919333 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:41.919761 23430 leader_election.cc:302] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:41.920171 23679 raft_consensus.cc:2354] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 for earlier term 2. Current term is 3.
I20260807 13:38:41.920169 23469 raft_consensus.cc:2454] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:41.920642 23430 leader_election.cc:302] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:41.921249 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:41.921427 23430 leader_election.cc:302] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:41.922824 23532 leader_election.cc:302] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
W20260807 13:38:41.822034 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 45150.4us
I20260807 13:38:41.872610 23470 raft_consensus.cc:2379] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:41.926481 24204 raft_consensus.cc:2781] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:38:41.926779 24350 raft_consensus.cc:2781] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:41.927346 24362 raft_consensus.cc:2781] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:38:41.789463 24205 consensus_queue.cc:237] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.928201 24190 consensus_queue.cc:1046] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:41.929332 24190 consensus_queue.cc:1046] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:41.930126 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:41.930873 23740 tablet_bootstrap.cc:492] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:41.930994 23577 raft_consensus.cc:2354] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3.
I20260807 13:38:41.849627 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:41.796482 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:41.788301 24315 raft_consensus.cc:3037] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:41.784539 24201 leader_election.cc:288] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:41.877486 23737 raft_consensus.cc:374] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:41.884284 23471 raft_consensus.cc:1226] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:41.884052 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:41.885143 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:41.794916 24303 raft_consensus.cc:2781] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260807 13:38:41.905679 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 114600us
W20260807 13:38:41.907145 23407 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:38:41.907121 23429 leader_election.cc:302] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters: 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:41.908685 23472 raft_consensus.cc:1261] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:41.913151 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:41.914822 23481 raft_consensus.cc:1226] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2. Ops: []
W20260807 13:38:41.915681 24381 log.cc:924] Time spent T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.121s user 0.000s sys 0.000s
W20260807 13:38:41.915830 23473 consensus_meta.cc:287] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.754s user 0.009s sys 0.005s
W20260807 13:38:41.779991 23676 rpcz_store.cc:269] 0807 13:38:39.851951 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:39.898138 (+ 46187us) service_pool.cc:227] Handling call
0807 13:38:41.647997 (+1749859us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b5400055d54. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:41.654695 (+ 6698us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1031369472}
W20260807 13:38:41.904001 24273 consensus_meta.cc:287] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.506s user 0.014s sys 0.000s
I20260807 13:38:41.924714 23532 leader_election.cc:302] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:41.873256 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:41.930786 24387 raft_consensus.cc:3032] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Stepping down as leader of term 1
W20260807 13:38:42.121111 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 196450us
I20260807 13:38:42.124413 23631 leader_election.cc:398] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Vote denied by peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037) with higher term. Message: Invalid argument: T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3.
W20260807 13:38:42.123270 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 216228us
I20260807 13:38:42.128404 23631 leader_election.cc:401] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:38:42.122434 23737 raft_consensus.cc:729] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:41.938464 23581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 213) took 1218 ms. Trace:
I20260807 13:38:42.123657 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 127) took 1043 ms. Trace:
I20260807 13:38:42.127792 23430 leader_election.cc:302] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:42.086696 24362 raft_consensus.cc:686] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:41.911760 24304 raft_consensus.cc:2781] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:38:42.131803 24326 raft_consensus.cc:3037] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 3
I20260807 13:38:41.903546 24169 raft_consensus.cc:504] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.136775 23739 tablet_bootstrap.cc:654] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:41.909260 24307 raft_consensus.cc:2726] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:42.139454 23532 leader_election.cc:302] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:42.130159 23737 consensus_queue.cc:260] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.936390 23671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57122 (request call id 199) took 1466 ms. Trace:
I20260807 13:38:41.955081 23679 raft_consensus.cc:2454] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
W20260807 13:38:41.984230 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 56621.4us
I20260807 13:38:42.131800 23481 rpcz_store.cc:276] 0807 13:38:41.080206 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:41.903910 (+823704us) service_pool.cc:227] Handling call
0807 13:38:41.914493 (+ 10583us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:42.123280 (+208787us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:42.123561 (+ 281us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:42.147284 23633 leader_election.cc:302] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:42.148111 23681 raft_consensus.cc:2379] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 2: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:42.142305 23532 leader_election.cc:302] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:42.137444 24304 raft_consensus.cc:686] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:42.148969 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:42.149225 24304 consensus_queue.cc:237] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.146528 24309 raft_consensus.cc:3037] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:41.937187 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:42.150614 23681 raft_consensus.cc:3037] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:42.151118 24326 raft_consensus.cc:2726] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037) with higher term. Message: Invalid argument: T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3.
I20260807 13:38:42.151953 23471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 122) took 1802 ms. Trace:
I20260807 13:38:42.134433 24362 consensus_queue.cc:237] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.153211 23577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 138) took 1018 ms. Trace:
I20260807 13:38:42.153839 23577 rpcz_store.cc:276] 0807 13:38:41.170934 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:41.239868 (+ 68934us) service_pool.cc:227] Handling call
0807 13:38:41.929996 (+690128us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ffbce 000000000034aea9 00007fc69cf2ba30 00007fc69cff17b4 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:42.143875 (+213879us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":66241280}
I20260807 13:38:42.145893 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4996c3c52ccc41b9a8da11ca747a8e6a" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:42.146457 24279 raft_consensus.cc:2781] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:42.155930 24279 raft_consensus.cc:482] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:42.155721 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:42.156452 24279 raft_consensus.cc:3037] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:38:42.156636 23532 leader_election.cc:341] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:42.156718 23577 raft_consensus.cc:3037] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 3
I20260807 13:38:42.157128 24309 raft_consensus.cc:2726] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:42.147917 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:42.151165 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:42.160540 23481 raft_consensus.cc:2379] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:42.160708 23578 raft_consensus.cc:3037] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:42.161499 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:42.162569 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:42.163543 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:42.142751 23671 rpcz_store.cc:276] 0807 13:38:40.523733 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:40.636080 (+112347us) service_pool.cc:227] Handling call
0807 13:38:41.936155 (+1300075us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b54003453d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:41.936329 (+ 174us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2228727552}
I20260807 13:38:42.164434 23481 raft_consensus.cc:3037] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:42.165508 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:42.157410 24201 raft_consensus.cc:2781] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:38:42.068593 23470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 247) took 1127 ms. Trace:
I20260807 13:38:42.159160 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:42.158494 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:42.086555 24360 raft_consensus.cc:2781] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:41.938197 24306 raft_consensus.cc:2781] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:42.138015 24169 leader_election.cc:288] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:41.934177 24323 raft_consensus.cc:482] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:42.170571 23532 leader_election.cc:302] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:42.079473 23672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 273) took 1267 ms. Trace:
I20260807 13:38:42.119526 23479 raft_consensus.cc:1226] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 4. Current term is 5. Ops: []
I20260807 13:38:42.125854 24387 raft_consensus.cc:729] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:42.002540 24241 raft_consensus.cc:504] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.127252 24345 raft_consensus.cc:2781] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:42.127339 24303 raft_consensus.cc:482] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:42.126737 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:42.138020 23677 raft_consensus.cc:3037] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 3
I20260807 13:38:42.179282 23580 raft_consensus.cc:1226] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:42.132129 24334 raft_consensus.cc:2726] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:42.130702 23473 raft_consensus.cc:2454] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:42.140427 24208 raft_consensus.cc:482] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:42.168728 23429 leader_election.cc:302] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:42.180691 24306 raft_consensus.cc:482] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:41.935424 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:42.183424 23532 leader_election.cc:302] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:42.178541 24201 raft_consensus.cc:686] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 2 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:42.175814 23472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 264) took 1024 ms. Trace:
I20260807 13:38:42.152335 23471 rpcz_store.cc:276] 0807 13:38:40.349560 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:40.354669 (+ 5109us) service_pool.cc:227] Handling call
0807 13:38:41.015158 (+660489us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b5800003398. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:38:41.864695 (+849537us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b5800003398. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ffb7c 00007fc6950ff73b 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:38:41.884071 (+ 19376us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:42.133056 (+248985us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:42.151856 (+ 18800us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":45874816}
I20260807 13:38:42.190483 24323 raft_consensus.cc:504] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.227131 24241 leader_election.cc:288] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:42.228046 24323 leader_election.cc:288] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:42.229156 24333 raft_consensus.cc:2781] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:42.229321 23681 raft_consensus.cc:2454] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:42.229591 24333 raft_consensus.cc:482] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:42.229982 24333 raft_consensus.cc:3037] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:42.229749 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:42.230314 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:42.230548 23471 raft_consensus.cc:2454] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:42.230957 23681 raft_consensus.cc:3037] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:41.933941 24204 raft_consensus.cc:686] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 5 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:42.102771 24320 raft_consensus.cc:504] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:41.995301 24305 raft_consensus.cc:504] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.190058 23737 ts_tablet_manager.cc:1428] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.511s user 0.020s sys 0.018s
I20260807 13:38:42.181820 24326 raft_consensus.cc:2726] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:42.131450 23581 rpcz_store.cc:276] 0807 13:38:40.719758 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:40.721077 (+ 1319us) service_pool.cc:227] Handling call
0807 13:38:41.938195 (+1217118us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b5400434ed4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:41.938387 (+ 192us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1939448192}
I20260807 13:38:42.128284 24273 raft_consensus.cc:504] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.243901 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:42.245127 24273 leader_election.cc:288] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:42.196491 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:42.256403 23571 raft_consensus.cc:2379] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 3: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:42.197517 24330 raft_consensus.cc:3037] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:42.258891 23740 tablet_bootstrap.cc:654] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:42.185535 24309 raft_consensus.cc:2726] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:42.185938 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:42.200322 24387 consensus_queue.cc:260] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:42.192790 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 45615.5us
I20260807 13:38:42.176297 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "608f7e63bc4648e0890e5f601c52736c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:42.179837 24360 raft_consensus.cc:482] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:42.178632 23680 raft_consensus.cc:3037] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:42.204552 23481 raft_consensus.cc:2454] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:42.139153 23675 raft_consensus.cc:2454] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
W20260807 13:38:42.242424 23737 ts_tablet_manager.cc:1460] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a: Tablet startup took 563ms
I20260807 13:38:42.208737 23429 leader_election.cc:398] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Vote denied by peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765) with higher term. Message: Invalid argument: T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 for earlier term 2. Current term is 3.
I20260807 13:38:42.193434 24303 raft_consensus.cc:3037] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:42.208796 23480 raft_consensus.cc:1226] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:42.242789 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "608f7e63bc4648e0890e5f601c52736c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:42.192778 24345 raft_consensus.cc:482] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:42.246246 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:42.273842 23573 raft_consensus.cc:2454] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:42.277685 23475 raft_consensus.cc:1226] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 2. Current term is 3. Ops: []
I20260807 13:38:42.247025 24305 leader_election.cc:288] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:42.249703 23430 leader_election.cc:302] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:42.229166 24201 consensus_queue.cc:237] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.252096 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:42.225471 23472 rpcz_store.cc:276] 0807 13:38:41.149711 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:41.900928 (+751217us) service_pool.cc:227] Handling call
0807 13:38:41.901210 (+ 282us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:42.130521 (+229311us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:42.173655 (+ 43134us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:42.254281 24204 consensus_queue.cc:237] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.260044 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:42.279860 23574 raft_consensus.cc:2379] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 3: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:42.224466 24306 raft_consensus.cc:3037] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:42.288280 24356 consensus_queue.cc:1035] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260807 13:38:42.297559 23739 tablet_bootstrap.cc:492] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:42.300029 23739 ts_tablet_manager.cc:1397] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.400s user 0.029s sys 0.009s
I20260807 13:38:42.267771 23471 raft_consensus.cc:1226] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3. Ops: []
I20260807 13:38:42.267859 24350 raft_consensus.cc:482] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:42.303956 24350 raft_consensus.cc:3037] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:42.304092 24273 raft_consensus.cc:2726] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:38:42.261946 23737 ts_tablet_manager.cc:1462] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a: Trace:
0807 13:38:28.006862 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:28.240969 (+234107us) service_pool.cc:227] Handling call
0807 13:38:28.329288 (+ 88319us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:38:28.329415 (+ 127us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:38:28.493956 (+164541us) tablet_metadata.cc:641] Metadata flushed
0807 13:38:28.527270 (+ 33314us) tablet_replica.cc:205] Creating consensus instance
0807 13:38:28.565664 (+ 38394us) inbound_call.cc:173] Queueing success response
0807 13:38:40.671514 (+12105850us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0807 13:38:41.679162 (+1007648us) ts_tablet_manager.cc:1429] Starting tablet replica
0807 13:38:41.781308 (+102146us) tablet_replica.cc:259] Starting instrumentation
0807 13:38:41.781866 (+ 558us) tablet_replica.cc:278] Starting consensus
Metrics: {"mutex_wait_us":960,"raft.queue_time_us":35009,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":4952,"tablet-open.queue_time_us":12111442}
I20260807 13:38:42.268102 23676 raft_consensus.cc:3037] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:42.268567 24387 raft_consensus.cc:3037] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:42.308558 23737 tablet_bootstrap.cc:492] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:42.269094 23478 raft_consensus.cc:2379] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:42.309187 23577 raft_consensus.cc:2454] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:42.309834 24306 raft_consensus.cc:504] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.245253 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:42.224411 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:42.202324 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:42.185128 23672 rpcz_store.cc:276] 0807 13:38:40.800555 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:41.012698 (+212143us) service_pool.cc:227] Handling call
0807 13:38:41.013038 (+ 340us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:41.789375 (+776337us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:42.067249 (+277874us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b5400030554. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:42.067551 (+ 302us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1560768384}
I20260807 13:38:42.271070 23675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57122 (request call id 205) took 1183 ms. Trace:
I20260807 13:38:42.271482 24345 raft_consensus.cc:3037] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:42.262164 24360 raft_consensus.cc:3037] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:42.272060 23633 leader_election.cc:302] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:42.272789 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:42.273116 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:42.329619 23575 raft_consensus.cc:2379] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 3: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:42.330786 23571 raft_consensus.cc:3037] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:42.284297 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 129) took 1203 ms. Trace:
I20260807 13:38:42.233420 24279 raft_consensus.cc:504] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.289207 23684 raft_consensus.cc:2454] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:42.290211 23679 raft_consensus.cc:2379] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 3: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:42.316267 23671 raft_consensus.cc:2379] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 3: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:42.172222 23470 rpcz_store.cc:276] 0807 13:38:40.941045 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:40.945226 (+ 4181us) service_pool.cc:227] Handling call
0807 13:38:42.068336 (+1123110us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b5400292554. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:42.068513 (+ 177us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2103768320}
I20260807 13:38:42.293339 23346 catalog_manager.cc:5495] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 1 to 2, leader changed from 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3) to 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2). New cstate: current_term: 2 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:42.291471 24190 raft_consensus.cc:482] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:42.294528 24362 consensus_queue.cc:1046] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:38:42.267132 23532 leader_election.cc:302] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:42.208581 24347 raft_consensus.cc:2726] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:42.300793 24320 leader_election.cc:288] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:42.224051 23473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 263) took 1074 ms. Trace:
I20260807 13:38:42.208335 24208 raft_consensus.cc:504] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.313431 23739 raft_consensus.cc:348] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.320989 23680 raft_consensus.cc:2454] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:42.280380 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:42.311770 23430 leader_election.cc:302] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:42.287756 23573 raft_consensus.cc:1261] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260807 13:38:42.315982 23578 raft_consensus.cc:2454] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:42.332376 23480 rpcz_store.cc:276] 0807 13:38:41.080728 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:41.899103 (+818375us) service_pool.cc:227] Handling call
0807 13:38:41.903384 (+ 4281us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:42.270626 (+367242us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:42.283921 (+ 13295us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b54001e2dd4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:42.284198 (+ 277us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":701889280}
I20260807 13:38:42.332877 23572 raft_consensus.cc:2454] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:42.335994 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:42.318270 24306 leader_election.cc:288] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:42.318369 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
W20260807 13:38:42.326076 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 56592.2us
I20260807 13:38:42.358269 23346 catalog_manager.cc:5495] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 0 to 2, leader changed from <none> to 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2). New cstate: current_term: 2 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:42.333844 24330 raft_consensus.cc:2726] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:38:42.349408 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 82318.6us
I20260807 13:38:42.364884 23532 leader_election.cc:302] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:42.352589 23473 rpcz_store.cc:276] 0807 13:38:41.149364 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:41.159889 (+ 10525us) service_pool.cc:227] Handling call
0807 13:38:42.209141 (+1049252us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:42.366215 24208 leader_election.cc:288] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:42.366662 23532 leader_election.cc:302] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:42.366822 24208 raft_consensus.cc:2726] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:42.367484 23532 leader_election.cc:302] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:42.368985 24320 raft_consensus.cc:2781] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election won for term 3
W20260807 13:38:42.351140 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 71878.3us
I20260807 13:38:42.318966 23675 rpcz_store.cc:276] 0807 13:38:41.091687 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:41.884811 (+793124us) service_pool.cc:227] Handling call
0807 13:38:42.269531 (+384720us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:42.352790 23739 raft_consensus.cc:374] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:42.357134 24348 raft_consensus.cc:2781] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:42.367449 24208 raft_consensus.cc:2781] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:42.314196 24303 raft_consensus.cc:504] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.326789 24315 raft_consensus.cc:504] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.356912 24201 raft_consensus.cc:2781] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:42.389935 23633 leader_election.cc:302] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:42.393020 23676 raft_consensus.cc:2454] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:42.392797 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:42.393620 23633 leader_election.cc:302] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:42.394100 23737 tablet_bootstrap.cc:654] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:42.394162 24330 raft_consensus.cc:2726] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:42.366398 23346 catalog_manager.cc:5495] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e11cad1eeaf5424c94e51241096f6613 (127.21.69.1). New cstate: current_term: 1 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } }
I20260807 13:38:42.355835 24326 raft_consensus.cc:482] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:42.370223 23532 leader_election.cc:341] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:42.359320 23572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 141) took 1082 ms. Trace:
I20260807 13:38:42.371172 23739 raft_consensus.cc:729] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:42.335044 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:42.396862 23684 raft_consensus.cc:2454] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:42.396123 23346 catalog_manager.cc:5495] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 1 to 2, leader changed from e11cad1eeaf5424c94e51241096f6613 (127.21.69.1) to 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2). New cstate: current_term: 2 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:42.362640 23681 raft_consensus.cc:2454] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:42.348201 24190 raft_consensus.cc:504] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.396248 23739 consensus_queue.cc:260] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.398336 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:42.397930 23533 leader_election.cc:302] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:42.368211 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:42.379029 24200 consensus_queue.cc:1035] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260807 13:38:42.382730 24273 raft_consensus.cc:3032] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:42.383273 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:42.385026 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "356c6b3e51454d418acaa9be70bb9689" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:42.377357 24348 raft_consensus.cc:482] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:42.381647 24208 raft_consensus.cc:482] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:42.394601 24304 raft_consensus.cc:2726] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:42.379679 24320 raft_consensus.cc:686] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:42.379719 23430 leader_election.cc:302] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:42.381480 23679 raft_consensus.cc:2354] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 2. Current term is 3.
I20260807 13:38:42.401449 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:42.395135 24326 raft_consensus.cc:504] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.393822 23676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57116 (request call id 288) took 1051 ms. Trace:
I20260807 13:38:42.409005 23739 ts_tablet_manager.cc:1428] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.108s user 0.004s sys 0.002s
I20260807 13:38:42.408898 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:42.409673 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:42.410172 23674 raft_consensus.cc:2454] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:42.410542 24348 raft_consensus.cc:3037] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:42.395180 23633 leader_election.cc:398] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363) with higher term. Message: Invalid argument: T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3.
W20260807 13:38:42.263188 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 55810.8us
I20260807 13:38:42.434214 23429 leader_election.cc:302] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:42.435927 23574 raft_consensus.cc:2379] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 3: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:42.376405 24333 raft_consensus.cc:504] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.411625 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:42.416162 24208 raft_consensus.cc:3037] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:42.379591 24204 consensus_queue.cc:1035] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260807 13:38:42.417693 24190 leader_election.cc:288] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:42.404703 24273 raft_consensus.cc:729] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:42.420656 23532 leader_election.cc:302] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:42.421068 24205 consensus_queue.cc:1046] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
W20260807 13:38:42.424453 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 44874.3us
I20260807 13:38:42.454381 23680 raft_consensus.cc:2454] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:42.461675 24205 raft_consensus.cc:2726] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:42.460075 24309 consensus_queue.cc:1035] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260807 13:38:42.462845 23680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 280) took 1283 ms. Trace:
I20260807 13:38:42.463384 24205 raft_consensus.cc:3032] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:38:42.465247 24205 raft_consensus.cc:729] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:42.464622 24273 consensus_queue.cc:260] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.470996 24273 raft_consensus.cc:3037] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:42.463245 23680 rpcz_store.cc:276] 0807 13:38:41.181209 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:42.461965 (+1280756us) service_pool.cc:227] Handling call
0807 13:38:42.462299 (+ 334us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:42.462485 (+ 186us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:42.462511 (+ 26us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:42.462552 (+ 41us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:42.462589 (+ 37us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:42.462650 (+ 61us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:42.462785 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:42.466734 24205 consensus_queue.cc:260] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.473088 24348 raft_consensus.cc:504] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.473443 24205 raft_consensus.cc:3037] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:42.411075 24360 raft_consensus.cc:504] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.428166 23684 raft_consensus.cc:2454] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:42.479790 23684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57116 (request call id 284) took 1235 ms. Trace:
I20260807 13:38:42.436813 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:42.481118 23681 raft_consensus.cc:2362] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3. Re-sending same reply.
I20260807 13:38:42.481781 23681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57122 (request call id 213) took 1009 ms. Trace:
I20260807 13:38:42.482169 23681 rpcz_store.cc:276] 0807 13:38:41.472634 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:42.436525 (+963891us) service_pool.cc:227] Handling call
0807 13:38:42.481711 (+ 45186us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:42.433027 23676 rpcz_store.cc:276] 0807 13:38:41.342663 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:42.138208 (+795545us) service_pool.cc:227] Handling call
0807 13:38:42.393746 (+255538us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:42.437628 24306 raft_consensus.cc:2726] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:42.480273 23684 rpcz_store.cc:276] 0807 13:38:41.244019 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:42.401010 (+1156991us) service_pool.cc:227] Handling call
0807 13:38:42.479695 (+ 78685us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:42.432797 24200 raft_consensus.cc:2781] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:42.486635 24360 leader_election.cc:288] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:42.486950 24200 raft_consensus.cc:482] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:42.487735 23684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 209) took 1016 ms. Trace:
I20260807 13:38:42.488675 23681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 286) took 1229 ms. Trace:
I20260807 13:38:42.489202 23681 rpcz_store.cc:276] 0807 13:38:41.259747 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:42.483048 (+1223301us) service_pool.cc:227] Handling call
0807 13:38:42.483472 (+ 424us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:42.488339 (+ 4867us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:42.488600 (+ 261us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:42.488131 23684 rpcz_store.cc:276] 0807 13:38:41.471014 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:42.486835 (+1015821us) service_pool.cc:227] Handling call
0807 13:38:42.487189 (+ 354us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:42.487370 (+ 181us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:42.487394 (+ 24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:42.487439 (+ 45us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:42.487470 (+ 31us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:42.487530 (+ 60us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:42.487678 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:42.487600 24200 raft_consensus.cc:3037] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:42.492977 23684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 218) took 1018 ms. Trace:
I20260807 13:38:42.493449 23684 rpcz_store.cc:276] 0807 13:38:41.474462 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:42.491887 (+1017425us) service_pool.cc:227] Handling call
0807 13:38:42.492332 (+ 445us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:42.492568 (+ 236us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:42.492606 (+ 38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:42.492661 (+ 55us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:42.492703 (+ 42us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:42.492771 (+ 68us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:42.492906 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:42.496723 23684 raft_consensus.cc:1226] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:42.497578 23684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 220) took 1022 ms. Trace:
I20260807 13:38:42.497964 23684 rpcz_store.cc:276] 0807 13:38:41.475055 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:42.495971 (+1020916us) service_pool.cc:227] Handling call
0807 13:38:42.496439 (+ 468us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:42.497263 (+ 824us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:42.497511 (+ 248us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:42.387421 23571 raft_consensus.cc:2454] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:42.404366 24201 raft_consensus.cc:686] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:42.499724 24201 consensus_queue.cc:237] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.500113 23677 raft_consensus.cc:2454] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:42.500838 23677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57116 (request call id 289) took 1068 ms. Trace:
I20260807 13:38:42.501433 23677 rpcz_store.cc:276] 0807 13:38:41.432238 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:41.778193 (+345955us) service_pool.cc:227] Handling call
0807 13:38:42.500771 (+722578us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:42.488201 24333 leader_election.cc:288] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:42.397581 23572 rpcz_store.cc:276] 0807 13:38:41.275375 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:41.590965 (+315590us) service_pool.cc:227] Handling call
0807 13:38:41.937601 (+346636us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:42.358034 (+420433us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8989440}
I20260807 13:38:42.440788 24326 leader_election.cc:288] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
W20260807 13:38:42.440727 23429 leader_election.cc:341] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:42.441263 23739 tablet_bootstrap.cc:492] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:42.441370 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:42.441823 24315 leader_election.cc:288] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:42.443248 23672 raft_consensus.cc:2454] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:42.443861 24350 raft_consensus.cc:504] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.444994 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:42.446280 24320 consensus_queue.cc:237] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.445501 24345 raft_consensus.cc:504] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.448529 24303 leader_election.cc:288] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:42.449432 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:42.511811 23679 raft_consensus.cc:2454] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:42.449673 24279 leader_election.cc:288] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:42.434625 24305 raft_consensus.cc:2781] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:42.415429 23671 raft_consensus.cc:2454] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
W20260807 13:38:42.451041 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 56011.4us
I20260807 13:38:42.474465 23680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 282) took 1283 ms. Trace:
I20260807 13:38:42.475234 24348 leader_election.cc:288] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:42.424925 23533 leader_election.cc:302] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
W20260807 13:38:42.517680 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 94135.5us
W20260807 13:38:42.518277 23533 leader_election.cc:341] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:42.504804 23429 leader_election.cc:302] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:42.507979 23430 leader_election.cc:302] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:42.512550 24350 leader_election.cc:288] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:42.512676 23481 raft_consensus.cc:1226] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:42.512653 24345 leader_election.cc:288] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:42.520550 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 79860.1us
I20260807 13:38:42.471470 24208 raft_consensus.cc:504] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.525779 23429 leader_election.cc:302] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:42.522357 23533 leader_election.cc:398] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765) with higher term. Message: Invalid argument: T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 2. Current term is 3.
I20260807 13:38:42.526158 23740 tablet_bootstrap.cc:492] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:42.526374 23533 leader_election.cc:401] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:38:42.526712 23740 ts_tablet_manager.cc:1397] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.596s user 0.019s sys 0.018s
I20260807 13:38:42.519994 24315 raft_consensus.cc:2781] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:38:42.527557 24315 raft_consensus.cc:686] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 2 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:42.524148 24241 raft_consensus.cc:2726] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:42.528827 24323 raft_consensus.cc:2726] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765) with higher term. Message: Invalid argument: T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 2. Current term is 3.
I20260807 13:38:42.528577 24306 raft_consensus.cc:2781] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:42.528576 24315 consensus_queue.cc:237] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.530457 23533 leader_election.cc:302] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:42.515944 23680 rpcz_store.cc:276] 0807 13:38:41.191044 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:42.473093 (+1282049us) service_pool.cc:227] Handling call
0807 13:38:42.473468 (+ 375us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:42.473662 (+ 194us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:42.473693 (+ 31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:42.473736 (+ 43us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:42.473772 (+ 36us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:42.474261 (+ 489us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:42.474399 (+ 138us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:42.531435 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:42.534237 23429 leader_election.cc:302] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:42.534477 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:42.532039 24326 raft_consensus.cc:482] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:42.535804 24279 raft_consensus.cc:2726] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:38:42.535874 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:42.518570 24305 raft_consensus.cc:686] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:42.533262 24303 raft_consensus.cc:482] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:42.535318 24306 raft_consensus.cc:686] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:42.537034 24303 raft_consensus.cc:504] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.537348 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:42.533316 24360 consensus_queue.cc:1035] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260807 13:38:42.538292 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:42.538321 24306 consensus_queue.cc:237] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:38:42.539183 24303 leader_election.cc:288] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:42.533814 24241 raft_consensus.cc:2726] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:38:42.539386 23429 leader_election.cc:302] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters: 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:42.535354 24326 raft_consensus.cc:504] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.537365 24305 consensus_queue.cc:237] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.540539 23429 leader_election.cc:302] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:42.541365 24326 leader_election.cc:288] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:42.532678 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:42.542260 23580 raft_consensus.cc:1226] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 5 LEADER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 4. Current term is 5. Ops: []
I20260807 13:38:42.542711 23572 raft_consensus.cc:2379] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 2: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:42.535262 23571 raft_consensus.cc:2354] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3.
I20260807 13:38:42.543427 24241 raft_consensus.cc:2726] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:42.543913 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:42.545047 24204 raft_consensus.cc:2781] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:42.546088 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:42.541268 24360 raft_consensus.cc:2781] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:42.546938 23480 raft_consensus.cc:2379] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 2: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:42.547938 23429 leader_election.cc:302] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:42.548667 23533 leader_election.cc:302] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
W20260807 13:38:42.551710 23533 leader_election.cc:341] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:42.549413 24204 raft_consensus.cc:686] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:42.552336 24309 consensus_queue.cc:1035] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:42.552704 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "356c6b3e51454d418acaa9be70bb9689" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:42.553850 24329 raft_consensus.cc:2781] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:42.554163 23575 raft_consensus.cc:1226] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:42.553550 24204 consensus_queue.cc:237] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.554402 24329 raft_consensus.cc:686] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:42.557122 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:42.557876 23479 raft_consensus.cc:2379] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
W20260807 13:38:42.558357 23532 leader_election.cc:341] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:42.559305 23429 leader_election.cc:302] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:42.560245 23532 leader_election.cc:302] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
W20260807 13:38:42.562368 23532 leader_election.cc:341] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:42.562831 23532 leader_election.cc:302] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:42.563482 23429 leader_election.cc:302] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:42.564302 23737 tablet_bootstrap.cc:492] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:42.564985 23737 ts_tablet_manager.cc:1397] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.257s user 0.015s sys 0.045s
I20260807 13:38:42.549998 24360 raft_consensus.cc:482] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:42.561141 24241 raft_consensus.cc:2726] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:42.556061 23574 raft_consensus.cc:2454] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 0.
I20260807 13:38:42.562062 24309 raft_consensus.cc:2726] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:42.555620 24329 consensus_queue.cc:237] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.567282 24201 raft_consensus.cc:482] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:42.567444 24350 raft_consensus.cc:2726] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:42.565779 24333 raft_consensus.cc:2726] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:42.572726 24360 raft_consensus.cc:3037] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:42.571718 24279 raft_consensus.cc:2726] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260807 13:38:42.604238 23429 leader_election.cc:341] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:42.569587 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:42.598899 23573 raft_consensus.cc:1226] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3. Ops: []
W20260807 13:38:42.624969 23631 leader_election.cc:341] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:42.628357 24208 leader_election.cc:288] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:42.628916 24303 consensus_queue.cc:1046] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:42.629310 24387 consensus_queue.cc:1046] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:38:42.630297 24304 raft_consensus.cc:3032] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:42.630368 24303 raft_consensus.cc:3032] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:38:42.600777 24309 raft_consensus.cc:482] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:42.628073 23740 raft_consensus.cc:348] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.632746 23740 raft_consensus.cc:374] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:42.633124 23740 raft_consensus.cc:729] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:42.634011 23740 consensus_queue.cc:260] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.612258 23473 raft_consensus.cc:1261] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:42.612808 24334 consensus_queue.cc:1046] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260807 13:38:42.643949 24334 raft_consensus.cc:3032] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:42.644359 24334 raft_consensus.cc:729] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:42.645728 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:42.646693 23481 raft_consensus.cc:2379] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 2: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:42.645431 24334 consensus_queue.cc:260] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.618062 23676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 287) took 1352 ms. Trace:
I20260807 13:38:42.657995 23737 raft_consensus.cc:348] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.658730 23737 raft_consensus.cc:374] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:42.659013 23737 raft_consensus.cc:729] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:42.630729 24304 raft_consensus.cc:729] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:42.654742 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:42.659595 23740 ts_tablet_manager.cc:1428] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.133s user 0.007s sys 0.002s
I20260807 13:38:42.660305 23737 consensus_queue.cc:260] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.660858 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:42.668614 23574 raft_consensus.cc:1226] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:42.669108 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:42.669152 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:42.670042 23680 raft_consensus.cc:2454] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:42.670601 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:42.671924 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:42.672693 23475 raft_consensus.cc:2354] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3.
I20260807 13:38:42.613138 24201 raft_consensus.cc:504] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.676240 23737 ts_tablet_manager.cc:1428] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.111s user 0.007s sys 0.001s
I20260807 13:38:42.680188 23481 raft_consensus.cc:1226] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260807 13:38:42.681120 23631 leader_election.cc:398] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Vote denied by peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037) with higher term. Message: Invalid argument: T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3.
I20260807 13:38:42.648936 23575 raft_consensus.cc:1226] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:42.681542 23631 leader_election.cc:401] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 13:38:42.664439 23469 raft_consensus.cc:2379] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:42.686507 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:42.641887 24303 raft_consensus.cc:729] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:42.692559 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:42.648384 24387 consensus_queue.cc:1046] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260807 13:38:42.647958 24309 raft_consensus.cc:504] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.657508 24330 consensus_queue.cc:1046] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260807 13:38:42.694849 23737 tablet_bootstrap.cc:492] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:42.858100 23481 raft_consensus.cc:1261] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:38:42.856910 24201 leader_election.cc:288] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:42.860015 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:42.856197 23740 tablet_bootstrap.cc:492] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:42.860972 23633 leader_election.cc:302] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
W20260807 13:38:42.738133 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 176245us
I20260807 13:38:42.862298 23633 leader_election.cc:302] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:42.779882 23739 tablet_bootstrap.cc:654] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:42.819888 23429 leader_election.cc:302] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters: 9ae273efd33642ad970ab8d1973917c1
W20260807 13:38:42.864952 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 45181.6us
I20260807 13:38:42.867437 24326 raft_consensus.cc:2726] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:42.867838 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:42.868629 23578 raft_consensus.cc:2454] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:42.869200 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:42.854529 24414 log.cc:924] Time spent T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.058s user 0.000s sys 0.000s
I20260807 13:38:42.873111 24362 raft_consensus.cc:2781] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:42.873557 24362 raft_consensus.cc:482] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:42.873909 24362 raft_consensus.cc:3037] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:42.815748 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:42.679524 24307 raft_consensus.cc:482] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:42.688481 23677 raft_consensus.cc:3037] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:38:42.815732 24411 log.cc:924] Time spent T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.178s user 0.001s sys 0.000s
I20260807 13:38:42.909600 23533 leader_election.cc:302] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:42.717923 24190 raft_consensus.cc:3037] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:42.689580 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:42.820111 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:42.796363 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:42.915360 23533 leader_election.cc:302] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:42.816630 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:42.787490 24334 raft_consensus.cc:3037] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:42.817662 23674 raft_consensus.cc:1261] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260807 13:38:42.792361 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:42.820988 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:42.924376 23533 leader_election.cc:302] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:42.932948 23430 leader_election.cc:302] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:42.916570 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:42.934454 23684 raft_consensus.cc:3037] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 3
I20260807 13:38:42.927695 23674 pending_rounds.cc:76] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Aborting all ops after (but not including) 0
I20260807 13:38:42.971967 23429 leader_election.cc:302] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:42.923117 24329 raft_consensus.cc:2781] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:42.778347 24200 raft_consensus.cc:504] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.889271 24315 consensus_queue.cc:1035] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260807 13:38:42.926261 24387 raft_consensus.cc:2726] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:42.978916 23674 pending_rounds.cc:97] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260807 13:38:42.931802 24204 raft_consensus.cc:2781] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:43.003512 23575 raft_consensus.cc:2379] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 2: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
W20260807 13:38:43.011809 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 149585us
I20260807 13:38:42.911001 24307 raft_consensus.cc:504] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.910125 24360 raft_consensus.cc:504] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.796687 24304 consensus_queue.cc:260] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:42.933027 23672 raft_consensus.cc:3037] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:42.940078 24306 raft_consensus.cc:2781] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:38:42.940290 24208 raft_consensus.cc:2781] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:43.027961 23684 raft_consensus.cc:2454] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:43.027369 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:42.977784 24330 raft_consensus.cc:3032] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:43.054505 23633 leader_election.cc:398] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Vote denied by peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363) with higher term. Message: Invalid argument: T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3.
I20260807 13:38:43.056136 23633 leader_election.cc:401] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 13:38:43.010928 24241 raft_consensus.cc:2726] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:38:43.024353 23674 raft_consensus.cc:2866] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260807 13:38:43.059216 24430 log.cc:924] Time spent T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.121s user 0.000s sys 0.000s
I20260807 13:38:43.025272 24204 raft_consensus.cc:482] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:43.064265 23480 raft_consensus.cc:1226] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 13:38:43.055406 24208 raft_consensus.cc:482] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:42.937847 24303 consensus_queue.cc:260] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.055938 24330 raft_consensus.cc:729] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:43.064730 24304 raft_consensus.cc:3037] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:43.062670 24306 raft_consensus.cc:686] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:43.063881 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:43.091312 23739 tablet_bootstrap.cc:492] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:43.069137 24204 raft_consensus.cc:3037] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:43.091987 23739 ts_tablet_manager.cc:1397] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.651s user 0.023s sys 0.013s
I20260807 13:38:43.084304 24208 raft_consensus.cc:3037] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:38:43.121979 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 67605us
I20260807 13:38:43.123539 23633 leader_election.cc:302] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:43.124861 23740 tablet_bootstrap.cc:654] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:43.126281 23633 leader_election.cc:302] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:43.111588 24200 leader_election.cc:288] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:43.118371 24309 leader_election.cc:288] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:43.145313 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:43.151661 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:43.156219 23574 raft_consensus.cc:2379] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 3: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:43.157397 23533 leader_election.cc:302] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:43.130637 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:43.137897 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:43.168572 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:42.657207 23676 rpcz_store.cc:276] 0807 13:38:41.263439 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:42.484256 (+1220817us) service_pool.cc:227] Handling call
0807 13:38:42.484663 (+ 407us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:42.484947 (+ 284us) raft_consensus.cc:1520] Early marking committed up to index 1
0807 13:38:42.495242 (+ 10295us) log.cc:842] Serialized 14 byte log entry
0807 13:38:42.574988 (+ 79746us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:42.580848 (+ 5860us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:42.598024 (+ 17176us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:42.600556 (+ 2532us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:42.616131 (+ 15575us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":34244,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":2037,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":22319,"spinlock_wait_cycles":9200256,"thread_start_us":81794,"threads_started":2,"wal-append.queue_time_us":75250}
I20260807 13:38:43.149948 24329 raft_consensus.cc:686] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:43.162751 24309 raft_consensus.cc:2726] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:38:43.194430 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 68260.8us
I20260807 13:38:43.177459 23582 raft_consensus.cc:1261] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:43.138170 24330 consensus_queue.cc:260] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:43.207887 23429 leader_election.cc:341] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:43.212217 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:43.212579 24190 raft_consensus.cc:2726] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037) with higher term. Message: Invalid argument: T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3.
I20260807 13:38:43.213708 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
W20260807 13:38:43.217252 23533 leader_election.cc:341] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:43.217880 23533 leader_election.cc:302] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:43.219400 23737 tablet_bootstrap.cc:654] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:43.219419 23533 leader_election.cc:302] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:43.180817 24436 raft_consensus.cc:2726] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:43.226796 23633 leader_election.cc:302] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:43.228006 23633 leader_election.cc:302] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:43.229949 23429 leader_election.cc:302] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:43.231196 23684 raft_consensus.cc:1261] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:43.196337 24307 leader_election.cc:288] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:43.154536 24306 consensus_queue.cc:237] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.200042 24438 raft_consensus.cc:2781] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:43.249966 23684 raft_consensus.cc:1261] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:43.256129 23684 raft_consensus.cc:1261] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:43.215955 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220c24fa0c52459182e1e89c74331f3b" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:43.248297 24279 raft_consensus.cc:2726] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:43.223470 24200 raft_consensus.cc:2726] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:38:43.224942 24309 raft_consensus.cc:2726] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:43.263311 24444 raft_consensus.cc:2726] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:43.267184 23429 leader_election.cc:302] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters: 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:43.271534 24326 raft_consensus.cc:3032] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:38:43.272049 24326 raft_consensus.cc:729] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:43.235886 24360 leader_election.cc:288] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:43.249049 24330 raft_consensus.cc:3037] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:43.278378 24449 consensus_queue.cc:1035] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:43.238822 24436 raft_consensus.cc:2726] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:43.289568 23739 raft_consensus.cc:348] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.295886 23739 raft_consensus.cc:374] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:43.296345 23739 raft_consensus.cc:729] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:43.297006 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:43.276298 24326 consensus_queue.cc:260] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:43.286070 23429 leader_election.cc:341] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:43.253288 24438 raft_consensus.cc:482] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:43.287494 23740 tablet_bootstrap.cc:492] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:43.273433 24307 raft_consensus.cc:482] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:43.297363 23739 consensus_queue.cc:260] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.302465 23740 ts_tablet_manager.cc:1397] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.446s user 0.035s sys 0.048s
I20260807 13:38:43.286859 24305 raft_consensus.cc:2781] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:43.279824 24440 consensus_queue.cc:1035] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260807 13:38:43.303342 24438 raft_consensus.cc:3037] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:43.274744 24444 raft_consensus.cc:482] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:43.223803 24345 consensus_queue.cc:1035] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260807 13:38:43.310240 23472 raft_consensus.cc:1261] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:43.310804 23478 raft_consensus.cc:1261] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:43.304282 23473 raft_consensus.cc:1261] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:43.311334 24305 raft_consensus.cc:686] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:43.311127 24201 consensus_queue.cc:1046] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:43.312168 24201 raft_consensus.cc:3032] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:38:43.312556 24201 raft_consensus.cc:729] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:43.312716 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:43.310699 23672 raft_consensus.cc:2454] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:43.312364 24305 consensus_queue.cc:237] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.314157 23532 leader_election.cc:302] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:43.309870 24307 raft_consensus.cc:504] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.275396 23574 raft_consensus.cc:2454] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:38:43.313261 24279 consensus_queue.cc:1035] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:43.300805 24309 raft_consensus.cc:482] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:43.330221 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 102312us
I20260807 13:38:43.333635 23633 leader_election.cc:302] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:43.335350 23633 leader_election.cc:302] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:43.264703 24329 consensus_queue.cc:237] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.347802 23430 leader_election.cc:302] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:43.313402 24201 consensus_queue.cc:260] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.317744 24434 raft_consensus.cc:2726] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363) with higher term. Message: Invalid argument: T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3.
W20260807 13:38:43.353263 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 45064.1us
I20260807 13:38:43.347846 24436 raft_consensus.cc:2781] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:43.357309 24436 raft_consensus.cc:482] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:43.357690 24436 raft_consensus.cc:3037] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:43.329528 24326 raft_consensus.cc:3037] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:38:43.364163 24409 log.cc:924] Time spent T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.793s user 0.011s sys 0.018s
I20260807 13:38:43.317484 24190 consensus_queue.cc:1046] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260807 13:38:43.321595 24333 raft_consensus.cc:2726] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:43.371501 24423 consensus_queue.cc:1035] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260807 13:38:43.366417 23429 leader_election.cc:302] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters: 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:43.378527 23739 ts_tablet_manager.cc:1428] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.284s user 0.010s sys 0.001s
I20260807 13:38:43.372612 23532 leader_election.cc:302] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:43.365326 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:43.386772 23680 raft_consensus.cc:3037] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:43.364221 24348 raft_consensus.cc:2781] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:43.334527 24309 raft_consensus.cc:504] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.315101 24444 raft_consensus.cc:504] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.393914 24201 raft_consensus.cc:3037] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:43.373193 24347 consensus_queue.cc:1035] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260807 13:38:43.432111 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
W20260807 13:38:43.435262 24362 consensus_meta.cc:287] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.561s user 0.004s sys 0.008s
I20260807 13:38:43.383221 24364 raft_consensus.cc:2781] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:43.344436 24320 consensus_queue.cc:1035] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260807 13:38:43.396570 24348 raft_consensus.cc:482] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:43.443297 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220c24fa0c52459182e1e89c74331f3b" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:43.445952 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 73422.5us
I20260807 13:38:43.446408 24437 raft_consensus.cc:2726] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:43.458460 23740 raft_consensus.cc:348] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.460216 23740 raft_consensus.cc:374] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:43.460572 23740 raft_consensus.cc:729] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:43.385866 24334 consensus_queue.cc:1035] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260807 13:38:43.463338 23681 raft_consensus.cc:1261] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260807 13:38:43.087386 24387 consensus_queue.cc:1159] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9ae273efd33642ad970ab8d1973917c1" responder_term: 5 status { last_received { term: 5 index: 3 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260807 13:38:43.462321 24315 raft_consensus.cc:482] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:43.477799 24306 raft_consensus.cc:482] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:43.436532 23672 raft_consensus.cc:1261] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260807 13:38:43.456064 24348 raft_consensus.cc:3037] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:43.490309 23672 pending_rounds.cc:76] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a: Aborting all ops after (but not including) 0
I20260807 13:38:43.492264 23672 pending_rounds.cc:97] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260807 13:38:43.491782 24306 raft_consensus.cc:504] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.492547 23672 raft_consensus.cc:2866] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:38:43.494081 24306 leader_election.cc:288] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:43.494232 23672 raft_consensus.cc:1261] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:43.436465 24458 raft_consensus.cc:482] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:43.478250 24429 raft_consensus.cc:3032] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Stepping down as leader of term 1
W20260807 13:38:43.497361 23429 leader_election.cc:341] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:43.463593 23740 consensus_queue.cc:260] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.479609 24208 raft_consensus.cc:504] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.463784 24364 raft_consensus.cc:686] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:43.517418 23740 ts_tablet_manager.cc:1428] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.211s user 0.008s sys 0.000s
I20260807 13:38:43.496888 24360 raft_consensus.cc:482] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:43.449757 24362 raft_consensus.cc:504] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.482888 24204 raft_consensus.cc:504] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.501760 24429 raft_consensus.cc:729] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:43.536399 23571 raft_consensus.cc:3037] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:43.464644 24453 consensus_queue.cc:1035] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260807 13:38:43.541682 23739 tablet_bootstrap.cc:492] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:43.502743 24458 raft_consensus.cc:504] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.514567 23470 raft_consensus.cc:1261] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260807 13:38:43.490224 24315 raft_consensus.cc:504] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.561260 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:43.562307 23578 raft_consensus.cc:2379] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 2: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:43.562354 24204 leader_election.cc:288] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:43.563235 24315 leader_election.cc:288] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:43.564476 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
W20260807 13:38:43.565178 23532 consensus_peers.cc:487] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 -> Peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Couldn't send request to peer e11cad1eeaf5424c94e51241096f6613. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:38:43.565711 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:43.536721 23478 raft_consensus.cc:1261] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:43.534562 24362 leader_election.cc:288] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:43.502952 24333 consensus_queue.cc:1035] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
I20260807 13:38:43.532070 24436 raft_consensus.cc:504] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.568972 23430 leader_election.cc:302] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:43.536420 24307 leader_election.cc:288] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:43.573588 23679 raft_consensus.cc:2454] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:43.564528 23740 tablet_bootstrap.cc:492] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:43.556206 23471 raft_consensus.cc:1226] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:43.587097 24436 leader_election.cc:288] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:43.587275 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:43.588687 24458 leader_election.cc:288] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:43.523603 24360 raft_consensus.cc:504] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.585399 24429 consensus_queue.cc:260] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.588160 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:43.621820 24429 raft_consensus.cc:3037] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:43.622646 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:43.588096 24364 consensus_queue.cc:237] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:43.601163 23532 leader_election.cc:341] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:43.604791 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:43.605041 24169 consensus_queue.cc:1035] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260807 13:38:43.635928 23532 leader_election.cc:341] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:43.606587 24438 raft_consensus.cc:504] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.608438 24444 leader_election.cc:288] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:43.609807 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:43.612254 23671 raft_consensus.cc:3037] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:43.613116 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
W20260807 13:38:43.616626 23677 consensus_meta.cc:287] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.705s user 0.010s sys 0.003s
I20260807 13:38:43.624158 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
W20260807 13:38:43.620841 24304 consensus_meta.cc:287] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.528s user 0.012s sys 0.001s
I20260807 13:38:43.646512 24320 consensus_queue.cc:1046] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.003s
I20260807 13:38:43.646593 24458 raft_consensus.cc:482] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:43.625377 24462 consensus_queue.cc:1159] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e11cad1eeaf5424c94e51241096f6613" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260807 13:38:43.662329 23580 raft_consensus.cc:2454] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:43.600538 24307 raft_consensus.cc:2726] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:43.634738 24360 leader_election.cc:288] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:43.624429 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:43.616786 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:43.634342 23572 raft_consensus.cc:3037] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:43.623596 23469 raft_consensus.cc:2454] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:38:43.679927 23430 leader_election.cc:302] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:43.663628 24309 leader_election.cc:288] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:43.650368 24455 consensus_queue.cc:1035] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260807 13:38:43.709215 24446 raft_consensus.cc:2726] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:43.709339 23677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 230) took 1653 ms. Trace:
I20260807 13:38:43.709781 23677 rpcz_store.cc:276] 0807 13:38:42.107147 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:42.687927 (+580780us) service_pool.cc:227] Handling call
0807 13:38:42.688310 (+ 383us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:43.709014 (+1020704us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:43.709268 (+ 254us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:43.711067 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:43.712878 23481 raft_consensus.cc:1261] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:43.690747 24360 raft_consensus.cc:2781] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:38:43.690691 23473 raft_consensus.cc:2454] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:43.695757 23674 raft_consensus.cc:2379] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:43.696072 24315 raft_consensus.cc:3032] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:43.698239 24303 raft_consensus.cc:3037] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:43.637473 24323 consensus_queue.cc:1035] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260807 13:38:43.701545 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:43.702176 24205 raft_consensus.cc:482] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:43.706071 23478 raft_consensus.cc:3037] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 2
I20260807 13:38:43.706642 24208 leader_election.cc:288] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:43.720626 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:43.718538 23631 leader_election.cc:302] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
W20260807 13:38:43.773032 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 54580.7us
I20260807 13:38:43.730159 24315 raft_consensus.cc:729] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:43.752108 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:43.671522 24458 raft_consensus.cc:504] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.755221 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:43.776657 23429 leader_election.cc:302] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:43.766808 23533 leader_election.cc:302] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:43.714598 23573 raft_consensus.cc:2454] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:38:43.778373 23577 raft_consensus.cc:3037] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:43.730670 24334 consensus_queue.cc:1035] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260807 13:38:43.731276 24360 raft_consensus.cc:686] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:43.778548 24462 raft_consensus.cc:2781] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:43.790374 24208 raft_consensus.cc:2726] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:38:43.793411 23680 raft_consensus.cc:2454] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:43.798646 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:43.801739 23737 tablet_bootstrap.cc:492] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:43.814746 23737 ts_tablet_manager.cc:1397] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 1.129s user 0.039s sys 0.023s
I20260807 13:38:43.801517 23429 leader_election.cc:302] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:43.804128 24315 consensus_queue.cc:260] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.805146 23532 leader_election.cc:302] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:43.797554 24347 raft_consensus.cc:2781] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:43.728670 24169 consensus_queue.cc:1035] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.072s
I20260807 13:38:43.817932 24348 raft_consensus.cc:504] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.813808 24462 raft_consensus.cc:482] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:43.819196 23680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57122 (request call id 246) took 1002 ms. Trace:
I20260807 13:38:43.819339 24438 leader_election.cc:288] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
W20260807 13:38:43.819427 24469 log.cc:924] Time spent T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.082s user 0.000s sys 0.000s
I20260807 13:38:43.820209 23740 tablet_bootstrap.cc:654] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:43.817698 24360 consensus_queue.cc:237] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.820041 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:43.857683 23679 raft_consensus.cc:2454] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:43.858843 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:43.824024 23430 leader_election.cc:302] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:43.820107 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:43.780695 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:43.814661 23472 raft_consensus.cc:2354] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 2. Current term is 3.
I20260807 13:38:43.847484 23739 tablet_bootstrap.cc:654] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:43.843081 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:43.843789 24347 raft_consensus.cc:686] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
W20260807 13:38:43.850751 24468 log.cc:924] Time spent T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.070s user 0.000s sys 0.000s
I20260807 13:38:43.851516 24348 leader_election.cc:288] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:43.844097 24462 raft_consensus.cc:3037] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:43.852545 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:43.844394 23680 rpcz_store.cc:276] 0807 13:38:42.816986 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:43.056001 (+239015us) service_pool.cc:227] Handling call
0807 13:38:43.365144 (+309143us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b5800004298. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:43.819118 (+453974us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5011200}
I20260807 13:38:43.864357 23679 raft_consensus.cc:2379] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 1: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:43.821331 24305 raft_consensus.cc:2726] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:43.832424 24455 raft_consensus.cc:2781] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:43.778805 24205 raft_consensus.cc:504] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.829653 24458 leader_election.cc:288] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:43.846171 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:43.859441 24330 consensus_meta.cc:287] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.571s user 0.008s sys 0.004s
W20260807 13:38:43.888684 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 64728.7us
I20260807 13:38:43.889599 23737 raft_consensus.cc:348] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.893412 23573 raft_consensus.cc:1261] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:43.925916 23737 raft_consensus.cc:374] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:43.926368 23737 raft_consensus.cc:729] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:43.895690 23684 raft_consensus.cc:1261] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260807 13:38:43.928272 23684 pending_rounds.cc:76] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a: Aborting all ops after (but not including) 2
I20260807 13:38:43.928582 23684 pending_rounds.cc:97] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260807 13:38:43.928875 23684 raft_consensus.cc:2866] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:38:43.896587 24260 raft_consensus.cc:2781] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:43.820778 24453 consensus_queue.cc:1035] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260807 13:38:43.897812 24440 raft_consensus.cc:482] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:43.900229 23633 leader_election.cc:302] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
W20260807 13:38:43.891371 24472 log.cc:924] Time spent T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.071s user 0.000s sys 0.000s
I20260807 13:38:43.898097 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:43.944990 23532 leader_election.cc:398] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Vote denied by peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037) with higher term. Message: Invalid argument: T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 2. Current term is 3.
I20260807 13:38:43.945581 23532 leader_election.cc:401] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260807 13:38:43.946818 23429 leader_election.cc:341] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:43.927258 23737 consensus_queue.cc:260] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:43.914176 23582 raft_consensus.cc:2396] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260807 13:38:43.963620 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 63520.3us
I20260807 13:38:43.881609 24465 raft_consensus.cc:482] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:43.918404 24455 raft_consensus.cc:482] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:43.986975 23429 leader_election.cc:302] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:43.935101 24260 raft_consensus.cc:482] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:43.979979 23571 raft_consensus.cc:2454] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:44.019833 24169 consensus_queue.cc:1035] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:44.020460 24330 raft_consensus.cc:482] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:44.020875 23737 ts_tablet_manager.cc:1428] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.206s user 0.007s sys 0.002s
I20260807 13:38:43.942328 24303 raft_consensus.cc:482] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:43.976234 24437 raft_consensus.cc:482] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:43.965772 24350 raft_consensus.cc:482] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:44.021421 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:44.032248 24345 raft_consensus.cc:2781] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:44.038587 24345 raft_consensus.cc:482] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:43.991796 24455 raft_consensus.cc:3037] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:44.023311 24260 raft_consensus.cc:3037] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:44.062268 23737 tablet_bootstrap.cc:492] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:43.991219 24440 raft_consensus.cc:504] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.065660 23582 raft_consensus.cc:1226] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:44.066932 24440 leader_election.cc:288] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:44.067283 23582 raft_consensus.cc:1261] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:44.068717 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:44.069449 23469 raft_consensus.cc:2454] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:44.071442 23430 leader_election.cc:302] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:44.017242 24438 raft_consensus.cc:482] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:44.073792 24438 raft_consensus.cc:504] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.022126 23675 raft_consensus.cc:1261] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:44.078563 24438 leader_election.cc:288] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:44.078637 24307 raft_consensus.cc:2726] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:38:44.079713 23532 leader_election.cc:302] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:44.080506 24305 consensus_queue.cc:1046] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:44.024330 24444 raft_consensus.cc:482] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:44.039067 24345 raft_consensus.cc:3037] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:44.024484 24304 raft_consensus.cc:482] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:44.034073 24458 raft_consensus.cc:482] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:44.086014 23533 leader_election.cc:302] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:44.028465 24190 raft_consensus.cc:482] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:44.024586 24449 raft_consensus.cc:2726] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037) with higher term. Message: Invalid argument: T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 2. Current term is 3.
I20260807 13:38:44.105335 23633 leader_election.cc:302] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
W20260807 13:38:44.107009 23533 leader_election.cc:341] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:44.096311 24438 raft_consensus.cc:482] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:44.040907 24450 raft_consensus.cc:482] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:44.039906 24435 raft_consensus.cc:482] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:43.914814 24347 consensus_queue.cc:237] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.034379 24330 raft_consensus.cc:504] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.097082 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220c24fa0c52459182e1e89c74331f3b" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:44.109671 24417 raft_consensus.cc:2781] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:44.117569 24434 raft_consensus.cc:2726] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:38:44.116807 23533 leader_election.cc:341] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:44.054780 24350 raft_consensus.cc:504] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.110737 24309 raft_consensus.cc:2726] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:38:44.018023 24465 raft_consensus.cc:504] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:38:44.179141 23533 leader_election.cc:302] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:44.112488 24307 consensus_queue.cc:1035] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
W20260807 13:38:44.175855 24326 consensus_meta.cc:287] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.813s user 0.008s sys 0.005s
I20260807 13:38:44.110338 24444 raft_consensus.cc:504] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.116677 24458 raft_consensus.cc:504] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.055509 24437 raft_consensus.cc:504] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.114151 24304 raft_consensus.cc:504] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.120369 24190 raft_consensus.cc:504] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.126371 24435 raft_consensus.cc:504] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.051862 24303 raft_consensus.cc:504] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.121333 24438 raft_consensus.cc:504] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.125135 24450 raft_consensus.cc:504] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.134652 24417 raft_consensus.cc:482] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:44.136475 24205 leader_election.cc:288] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:44.129861 24440 raft_consensus.cc:482] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:44.578469 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 461686us
I20260807 13:38:44.320957 24350 leader_election.cc:288] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:44.579878 23429 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.558s user 0.013s sys 0.016s
W20260807 13:38:44.597429 23429 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.576s user 0.014s sys 0.016s
W20260807 13:38:44.598021 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 611152us
W20260807 13:38:44.319535 24477 log.cc:924] Time spent T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.138s user 0.000s sys 0.000s
W20260807 13:38:44.571076 24476 log.cc:924] Time spent T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.126s user 0.000s sys 0.000s
W20260807 13:38:44.608340 23631 leader_election.cc:341] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:44.614544 24437 leader_election.cc:288] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:44.304368 24333 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s user 0.044s sys 0.146s
I20260807 13:38:44.256834 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:44.578193 24417 raft_consensus.cc:3037] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:44.665033 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:44.344141 23473 raft_consensus.cc:1261] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:44.156776 23573 raft_consensus.cc:3037] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:38:44.236577 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 53507.5us
I20260807 13:38:44.228250 24279 raft_consensus.cc:482] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:44.323916 23577 raft_consensus.cc:2454] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
W20260807 13:38:44.666870 23572 consensus_meta.cc:287] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.947s user 0.011s sys 0.000s
I20260807 13:38:44.689512 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:44.690016 23572 raft_consensus.cc:2454] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:44.672696 23740 tablet_bootstrap.cc:492] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:44.690871 23740 ts_tablet_manager.cc:1397] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 1.127s user 0.040s sys 0.040s
I20260807 13:38:44.602238 24440 raft_consensus.cc:504] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.665903 23475 raft_consensus.cc:1261] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:44.716591 23475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 149) took 1213 ms. Trace:
I20260807 13:38:44.716724 24205 raft_consensus.cc:482] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:44.717113 23475 rpcz_store.cc:276] 0807 13:38:43.502970 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:43.505105 (+ 2135us) service_pool.cc:227] Handling call
0807 13:38:44.651341 (+1146236us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b5800003398. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:38:44.665534 (+ 14193us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:44.716289 (+ 50755us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:44.716520 (+ 231us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":13613952}
W20260807 13:38:44.718598 23671 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s user 0.011s sys 0.052s
W20260807 13:38:44.326333 24429 consensus_meta.cc:287] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.704s user 0.010s sys 0.008s
I20260807 13:38:44.664939 24303 leader_election.cc:288] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:44.654105 24326 raft_consensus.cc:482] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:44.607244 24434 raft_consensus.cc:482] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:44.658850 24333 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.954s user 0.053s sys 0.161s
I20260807 13:38:44.683286 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 316) took 1044 ms. Trace:
W20260807 13:38:44.690538 23572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 268) took 1593 ms (client timeout 1943 ms). Trace:
I20260807 13:38:44.686784 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:44.696548 23429 leader_election.cc:302] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:44.677825 24330 leader_election.cc:288] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:44.690382 23578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 287) took 1192 ms. Trace:
I20260807 13:38:44.690668 24279 raft_consensus.cc:504] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.689538 23582 raft_consensus.cc:1226] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 13:38:44.687150 24309 raft_consensus.cc:482] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:44.717271 24205 raft_consensus.cc:504] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.732882 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "608f7e63bc4648e0890e5f601c52736c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:44.689172 23577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 160) took 1025 ms. Trace:
I20260807 13:38:44.751474 24330 raft_consensus.cc:482] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:44.764781 23577 rpcz_store.cc:276] 0807 13:38:43.683632 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:43.713671 (+ 30039us) service_pool.cc:227] Handling call
0807 13:38:44.689096 (+975425us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:44.766566 24330 raft_consensus.cc:504] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.767473 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:44.768465 23577 raft_consensus.cc:2379] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 2: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:44.770347 23577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 286) took 1282 ms. Trace:
W20260807 13:38:44.771474 24462 consensus_meta.cc:287] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.869s user 0.013s sys 0.000s
I20260807 13:38:44.772110 24462 raft_consensus.cc:504] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:44.776448 24478 log.cc:924] Time spent T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.222s user 0.000s sys 0.001s
I20260807 13:38:44.769668 24330 leader_election.cc:288] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:44.737833 23740 raft_consensus.cc:348] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.188923 24329 raft_consensus.cc:2726] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 13:38:44.731405 24345 consensus_meta.cc:287] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.612s user 0.010s sys 0.000s
I20260807 13:38:44.714604 23676 raft_consensus.cc:1261] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260807 13:38:44.800302 23676 pending_rounds.cc:76] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Aborting all ops after (but not including) 1
I20260807 13:38:44.678328 24201 raft_consensus.cc:482] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
W20260807 13:38:44.733213 23671 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s user 0.011s sys 0.052s
W20260807 13:38:44.746984 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 50567.5us
W20260807 13:38:44.756028 23478 consensus_meta.cc:287] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.977s user 0.007s sys 0.007s
I20260807 13:38:44.770794 23577 rpcz_store.cc:276] 0807 13:38:43.487878 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:44.769262 (+1281384us) service_pool.cc:227] Handling call
0807 13:38:44.769740 (+ 478us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:44.769953 (+ 213us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:44.769987 (+ 34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:44.770034 (+ 47us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:44.770078 (+ 44us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:44.770146 (+ 68us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:44.770282 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:44.756999 24279 leader_election.cc:288] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:44.748716 23578 rpcz_store.cc:276] 0807 13:38:43.498342 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:43.563085 (+ 64743us) service_pool.cc:227] Handling call
0807 13:38:44.689386 (+1126301us) spinlock_profiling.cc:243] Waited 9.34 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ffbce 000000000034aea9 00007fc69cf2ba30 00007fc69cff17b4 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:44.690321 (+ 935us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":21487360}
I20260807 13:38:44.702518 24437 raft_consensus.cc:482] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:44.786453 23740 raft_consensus.cc:374] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:44.749215 24429 raft_consensus.cc:482] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:44.744225 24465 leader_election.cc:288] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037)
I20260807 13:38:44.736740 23480 rpcz_store.cc:276] 0807 13:38:43.639611 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:43.702955 (+ 63344us) service_pool.cc:227] Handling call
0807 13:38:43.703282 (+ 327us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:43.703617 (+ 335us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:43.704177 (+ 560us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:43.704604 (+ 427us) log.cc:842] Serialized 26 byte log entry
0807 13:38:43.949298 (+244694us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:43.949355 (+ 57us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:43.949445 (+ 90us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:44.683070 (+733625us) raft_consensus.cc:1671] finished
0807 13:38:44.683090 (+ 20us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:44.683219 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":495,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":74,"thread_start_us":244266,"threads_started":1,"wal-append.queue_time_us":408373}
I20260807 13:38:44.801244 23479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 311) took 1280 ms. Trace:
I20260807 13:38:44.775379 24462 leader_election.cc:288] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:44.743072 24434 raft_consensus.cc:504] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:44.805722 23631 leader_election.cc:341] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:44.879613 23740 raft_consensus.cc:729] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
W20260807 13:38:44.880586 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 74908.2us
I20260807 13:38:44.881454 23677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 322) took 1392 ms. Trace:
I20260807 13:38:44.881158 23740 consensus_queue.cc:260] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.741575 24326 raft_consensus.cc:504] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.823107 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:44.823879 24190 leader_election.cc:288] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:44.823983 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:44.825073 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:44.825734 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:44.802960 23676 pending_rounds.cc:97] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 13:38:44.827863 24304 leader_election.cc:288] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:44.828997 24438 leader_election.cc:288] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:44.807145 24330 consensus_queue.cc:1035] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
W20260807 13:38:44.742090 23572 rpcz_store.cc:269] 0807 13:38:43.097688 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:43.104447 (+ 6759us) service_pool.cc:227] Handling call
0807 13:38:43.581047 (+476600us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:44.690482 (+1109435us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5455232}
W20260807 13:38:44.875878 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 65063.8us
I20260807 13:38:44.876271 24329 raft_consensus.cc:482] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:44.929015 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:44.930058 23681 raft_consensus.cc:2354] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 2. Current term is 3.
I20260807 13:38:44.752975 24307 raft_consensus.cc:2781] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:44.803633 24345 raft_consensus.cc:504] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.880347 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:44.938357 23480 raft_consensus.cc:2379] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:44.879814 23684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 313) took 1785 ms. Trace:
I20260807 13:38:44.900593 23740 ts_tablet_manager.cc:1428] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.209s user 0.005s sys 0.002s
I20260807 13:38:44.880079 23479 rpcz_store.cc:276] 0807 13:38:43.520443 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:43.520631 (+ 188us) service_pool.cc:227] Handling call
0807 13:38:43.521093 (+ 462us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:43.624311 (+103218us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:43.624338 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:43.624873 (+ 535us) log.cc:842] Serialized 26 byte log entry
0807 13:38:43.977087 (+352214us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:43.977128 (+ 41us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:44.058693 (+ 81565us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b540026c5d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:44.058746 (+ 53us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:44.784120 (+725374us) raft_consensus.cc:1671] finished
0807 13:38:44.784148 (+ 28us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:44.801154 (+ 17006us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1294,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":15703,"spinlock_wait_cycles":236526976,"thread_start_us":351813,"threads_started":1,"wal-append.queue_time_us":636878}
I20260807 13:38:44.907120 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:44.881844 24434 leader_election.cc:288] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:44.792474 24309 raft_consensus.cc:504] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.877225 24450 leader_election.cc:288] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:44.912909 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:44.899813 24417 raft_consensus.cc:504] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.910248 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:44.908520 24435 leader_election.cc:288] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:44.913919 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:44.914510 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:44.918459 23737 tablet_bootstrap.cc:654] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:44.879828 24429 raft_consensus.cc:504] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.930516 23681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57116 (request call id 330) took 1223 ms. Trace:
I20260807 13:38:44.882833 24458 leader_election.cc:288] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:44.856419 24201 raft_consensus.cc:504] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.954571 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 318) took 1314 ms. Trace:
I20260807 13:38:44.938709 23684 rpcz_store.cc:276] 0807 13:38:43.094537 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:43.256802 (+162265us) service_pool.cc:227] Handling call
0807 13:38:43.257076 (+ 274us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:43.929378 (+672302us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:44.879515 (+950137us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b54003453d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:44.879742 (+ 227us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1467743616}
I20260807 13:38:44.912446 24440 leader_election.cc:288] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:44.908537 23676 raft_consensus.cc:2866] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:38:44.955019 23481 rpcz_store.cc:276] 0807 13:38:43.640552 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:43.719184 (+ 78632us) service_pool.cc:227] Handling call
0807 13:38:43.719627 (+ 443us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:43.724560 (+ 4933us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:43.724601 (+ 41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:43.725167 (+ 566us) log.cc:842] Serialized 26 byte log entry
0807 13:38:44.081812 (+356645us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:44.081858 (+ 46us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:44.081930 (+ 72us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:44.954345 (+872415us) raft_consensus.cc:1671] finished
0807 13:38:44.954366 (+ 21us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:44.954508 (+ 142us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4388,"raft.queue_time_us":5305,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":33947,"thread_start_us":306204,"threads_started":1,"wal-append.queue_time_us":1017590}
W20260807 13:38:44.943738 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 474164us
I20260807 13:38:44.941637 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:44.940630 24334 raft_consensus.cc:482] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:44.952874 23740 tablet_bootstrap.cc:492] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:44.953397 23739 tablet_bootstrap.cc:492] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:44.952515 23681 rpcz_store.cc:276] 0807 13:38:43.707566 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:43.776417 (+ 68851us) service_pool.cc:227] Handling call
0807 13:38:44.928843 (+1152426us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b5800004298. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:44.930451 (+ 1608us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":9495808}
I20260807 13:38:44.939461 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 291) took 1307 ms. Trace:
I20260807 13:38:44.956112 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220c24fa0c52459182e1e89c74331f3b" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:44.942354 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:44.941380 24307 raft_consensus.cc:686] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
W20260807 13:38:44.967367 24484 log.cc:924] Time spent T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.062s user 0.000s sys 0.000s
I20260807 13:38:44.901994 24437 raft_consensus.cc:504] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.969959 24437 leader_election.cc:288] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:44.970366 23681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 324) took 1430 ms. Trace:
I20260807 13:38:44.970943 23684 raft_consensus.cc:1226] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 13:38:44.967315 24307 consensus_queue.cc:237] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:44.971623 23684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 265) took 1369 ms. Trace:
I20260807 13:38:44.972401 23684 rpcz_store.cc:276] 0807 13:38:43.602363 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:44.970415 (+1368052us) service_pool.cc:227] Handling call
0807 13:38:44.970727 (+ 312us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:44.971370 (+ 643us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:44.971571 (+ 201us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:44.973874 23684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 268) took 1370 ms. Trace:
I20260807 13:38:44.974176 23684 rpcz_store.cc:276] 0807 13:38:43.603373 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:44.973123 (+1369750us) service_pool.cc:227] Handling call
0807 13:38:44.973403 (+ 280us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:44.973557 (+ 154us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:44.973581 (+ 24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:44.973618 (+ 37us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:44.973646 (+ 28us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:44.973693 (+ 47us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:44.973787 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:44.975591 23684 raft_consensus.cc:1261] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:44.976280 23684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 327) took 1361 ms. Trace:
I20260807 13:38:44.970713 23681 rpcz_store.cc:276] 0807 13:38:43.539489 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:44.969554 (+1430065us) service_pool.cc:227] Handling call
0807 13:38:44.969867 (+ 313us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:44.970059 (+ 192us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:44.970087 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:44.970125 (+ 38us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:44.970153 (+ 28us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:44.970203 (+ 50us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:44.970309 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:44.976636 23684 rpcz_store.cc:276] 0807 13:38:43.615331 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:44.974995 (+1359664us) service_pool.cc:227] Handling call
0807 13:38:44.975262 (+ 267us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:44.976052 (+ 790us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:44.976232 (+ 180us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:44.977574 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4996c3c52ccc41b9a8da11ca747a8e6a" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:44.965745 23580 rpcz_store.cc:276] 0807 13:38:43.632471 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:44.906871 (+1274400us) service_pool.cc:227] Handling call
0807 13:38:44.939410 (+ 32539us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:44.977371 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:44.979776 23429 leader_election.cc:341] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:44.965415 23739 ts_tablet_manager.cc:1397] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 1.424s user 0.034s sys 0.035s
I20260807 13:38:44.980708 23684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 269) took 1333 ms. Trace:
I20260807 13:38:44.981634 23430 leader_election.cc:302] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:44.988269 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4996c3c52ccc41b9a8da11ca747a8e6a" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:44.938640 24329 raft_consensus.cc:504] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:44.989208 23429 leader_election.cc:341] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:44.954191 24205 leader_election.cc:288] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:44.958582 23469 raft_consensus.cc:3037] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:44.981158 23684 rpcz_store.cc:276] 0807 13:38:43.667757 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:44.979165 (+1311408us) service_pool.cc:227] Handling call
0807 13:38:44.980066 (+ 901us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:44.980317 (+ 251us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:44.980342 (+ 25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:44.980378 (+ 36us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:44.980417 (+ 39us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:44.980566 (+ 149us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:44.980657 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:44.991827 23430 leader_election.cc:302] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
W20260807 13:38:44.993788 23430 leader_election.cc:341] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:44.994329 23430 leader_election.cc:302] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:44.881839 23677 rpcz_store.cc:276] 0807 13:38:43.488671 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:43.991055 (+502384us) service_pool.cc:227] Handling call
0807 13:38:44.105757 (+114702us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:44.685119 (+579362us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:44.690003 (+ 4884us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:44.690060 (+ 57us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:44.690102 (+ 42us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:44.881204 (+191102us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b540018b5d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:44.881249 (+ 45us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:44.881384 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1302852352}
I20260807 13:38:44.987792 24347 raft_consensus.cc:482] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:44.997913 24362 raft_consensus.cc:2726] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:45.006745 24347 raft_consensus.cc:504] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.007464 23677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 331) took 1208 ms. Trace:
I20260807 13:38:44.997922 24356 raft_consensus.cc:2726] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:45.008006 23677 rpcz_store.cc:276] 0807 13:38:43.799437 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:44.997665 (+1198228us) service_pool.cc:227] Handling call
0807 13:38:45.006889 (+ 9224us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:45.007083 (+ 194us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:45.007112 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:45.007160 (+ 48us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:45.007196 (+ 36us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:45.007257 (+ 61us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:45.007398 (+ 141us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:45.009388 24347 leader_election.cc:288] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:45.009653 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b078a19f38494b04ad11b14d98ec4bca" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:45.009891 23677 raft_consensus.cc:1261] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:44.997951 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:44.986722 24326 leader_election.cc:288] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:44.988628 23578 raft_consensus.cc:1261] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:44.985427 24333 consensus_queue.cc:1035] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260807 13:38:44.983009 24334 raft_consensus.cc:504] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.010681 24458 raft_consensus.cc:482] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:45.070250 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:44.995558 24279 consensus_queue.cc:1046] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260807 13:38:45.055187 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 293) took 1344 ms. Trace:
I20260807 13:38:45.079835 23580 rpcz_store.cc:276] 0807 13:38:43.710956 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:44.989187 (+1278231us) service_pool.cc:227] Handling call
0807 13:38:45.054503 (+ 65316us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:45.054746 (+ 243us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:45.054780 (+ 34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:45.054836 (+ 56us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:45.054878 (+ 42us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:45.054952 (+ 74us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:45.055109 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:45.084928 23573 raft_consensus.cc:2454] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:45.084619 23739 raft_consensus.cc:348] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.051851 23572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 290) took 1455 ms. Trace:
I20260807 13:38:45.085805 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:45.086704 24481 log.cc:924] Time spent T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.211s user 0.000s sys 0.001s
I20260807 13:38:45.086997 24334 leader_election.cc:288] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:45.087759 24326 raft_consensus.cc:482] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:45.089226 24329 leader_election.cc:288] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:45.090147 24417 leader_election.cc:288] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:45.091241 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:45.092399 24260 consensus_meta.cc:287] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.993s user 0.012s sys 0.000s
I20260807 13:38:45.096704 23739 raft_consensus.cc:374] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:45.077061 24458 raft_consensus.cc:504] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.154520 23739 raft_consensus.cc:729] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:45.155476 23739 consensus_queue.cc:260] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.087049 24497 raft_consensus.cc:482] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:45.096412 24330 raft_consensus.cc:482] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:45.096719 24435 raft_consensus.cc:482] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:45.160497 23580 raft_consensus.cc:1261] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260807 13:38:45.162285 23740 tablet_bootstrap.cc:654] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:45.137375 23573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 296) took 1213 ms. Trace:
I20260807 13:38:45.268090 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:45.137820 23677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 272) took 1083 ms. Trace:
I20260807 13:38:45.296741 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 294) took 1585 ms. Trace:
W20260807 13:38:45.210299 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 55163.2us
I20260807 13:38:45.280304 24204 raft_consensus.cc:482] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:45.299427 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:45.153932 24326 raft_consensus.cc:504] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.306591 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:45.304701 23580 rpcz_store.cc:276] 0807 13:38:43.711608 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:45.094104 (+1382496us) service_pool.cc:227] Handling call
0807 13:38:45.160036 (+ 65932us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:45.296445 (+136409us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:45.296675 (+ 230us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:45.308297 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "356c6b3e51454d418acaa9be70bb9689" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:45.269120 24455 consensus_meta.cc:287] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 1.184s user 0.001s sys 0.013s
I20260807 13:38:45.388775 23739 ts_tablet_manager.cc:1428] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.408s user 0.008s sys 0.007s
I20260807 13:38:45.388319 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:45.146114 24305 raft_consensus.cc:2726] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:45.217545 24309 leader_election.cc:288] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:45.268390 24458 leader_election.cc:288] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:45.256423 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:45.263726 24334 raft_consensus.cc:482] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:45.146731 23472 raft_consensus.cc:2454] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:45.388101 24356 raft_consensus.cc:3032] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:38:45.322438 23671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 251) took 2503 ms. Trace:
I20260807 13:38:45.322852 24487 raft_consensus.cc:482] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:45.300782 23573 rpcz_store.cc:276] 0807 13:38:43.923535 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:44.039061 (+115526us) service_pool.cc:227] Handling call
0807 13:38:45.113865 (+1074804us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:45.265659 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:45.217868 24201 leader_election.cc:288] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:45.392371 23580 raft_consensus.cc:2454] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:45.163607 24461 raft_consensus.cc:2726] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:45.401356 23739 tablet_bootstrap.cc:492] T 608f7e63bc4648e0890e5f601c52736c P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:45.145884 24450 raft_consensus.cc:482] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:45.198627 24497 raft_consensus.cc:504] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.404008 23473 raft_consensus.cc:3037] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:45.164835 24345 leader_election.cc:288] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:45.101632 23572 rpcz_store.cc:276] 0807 13:38:43.593950 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:44.940029 (+1346079us) service_pool.cc:227] Handling call
0807 13:38:44.958369 (+ 18340us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:44.984230 (+ 25861us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:44.985743 (+ 1513us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:44.990473 (+ 4730us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:44.992175 (+ 1702us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:44.998987 (+ 6812us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:45.048817 (+ 49830us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:45.304277 23677 rpcz_store.cc:276] 0807 13:38:44.063268 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:45.009052 (+945784us) service_pool.cc:227] Handling call
0807 13:38:45.009376 (+ 324us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:45.064190 (+ 54814us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:45.121567 (+ 57377us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:38:45.406684 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 103370us
I20260807 13:38:45.441318 23430 leader_election.cc:302] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:45.213168 24434 raft_consensus.cc:482] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:45.413149 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
W20260807 13:38:45.248673 24498 log.cc:924] Time spent T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.184s user 0.002s sys 0.000s
I20260807 13:38:45.163010 24260 raft_consensus.cc:504] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.389600 24347 raft_consensus.cc:482] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:45.389253 24169 raft_consensus.cc:482] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:45.300433 23469 raft_consensus.cc:2454] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4.
I20260807 13:38:45.301062 24435 raft_consensus.cc:504] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.394747 24362 raft_consensus.cc:482] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:45.213253 24429 leader_election.cc:288] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:45.426033 24437 raft_consensus.cc:482] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:45.405628 24505 raft_consensus.cc:482] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:45.256362 24333 raft_consensus.cc:482] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:45.217491 23478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 317) took 1577 ms. Trace:
W20260807 13:38:45.421168 24474 log.cc:924] Time spent T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 1.363s user 0.000s sys 0.006s
I20260807 13:38:45.397830 24455 raft_consensus.cc:504] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.449783 23479 raft_consensus.cc:1226] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:38:45.411319 24356 raft_consensus.cc:729] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:45.419714 24201 raft_consensus.cc:482] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:45.453815 23430 leader_election.cc:302] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:45.456823 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 295) took 1744 ms. Trace:
I20260807 13:38:45.426658 24458 raft_consensus.cc:482] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:45.460278 23631 leader_election.cc:302] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
W20260807 13:38:45.458452 24500 log.cc:924] Time spent T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.260s user 0.001s sys 0.000s
I20260807 13:38:45.411693 24334 raft_consensus.cc:504] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:38:45.444622 24306 raft_consensus.cc:482] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:45.454873 23575 raft_consensus.cc:2379] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 1: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:45.493444 23580 rpcz_store.cc:276] 0807 13:38:43.712684 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:45.454726 (+1742042us) service_pool.cc:227] Handling call
0807 13:38:45.456327 (+ 1601us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:45.456513 (+ 186us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:45.456540 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:45.456579 (+ 39us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:45.456610 (+ 31us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:45.456660 (+ 50us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:45.456763 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:45.456635 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:45.434988 24450 raft_consensus.cc:504] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.459563 24345 raft_consensus.cc:2781] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:45.357249 24204 raft_consensus.cc:504] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.521713 24204 leader_election.cc:288] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:45.322706 24330 raft_consensus.cc:504] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.456216 24279 consensus_queue.cc:1035] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.050s
I20260807 13:38:45.481263 24505 raft_consensus.cc:504] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.524394 24330 leader_election.cc:288] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:45.524904 24279 raft_consensus.cc:482] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:45.525076 24330 raft_consensus.cc:482] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:45.525489 24279 raft_consensus.cc:504] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.525826 24505 leader_election.cc:288] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:45.510828 24306 raft_consensus.cc:504] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.490113 24360 raft_consensus.cc:482] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:45.527926 24360 raft_consensus.cc:504] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.516000 24345 raft_consensus.cc:482] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:45.529107 24345 raft_consensus.cc:3037] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:45.530330 24360 leader_election.cc:288] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:45.436877 24487 raft_consensus.cc:504] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.455528 24169 raft_consensus.cc:504] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.532145 24326 leader_election.cc:288] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:45.532385 24487 leader_election.cc:288] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:45.503408 24333 raft_consensus.cc:504] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.450608 24434 raft_consensus.cc:504] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.515981 23573 raft_consensus.cc:2362] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3. Re-sending same reply.
I20260807 13:38:45.510486 24429 raft_consensus.cc:2781] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:38:45.504350 23478 rpcz_store.cc:276] 0807 13:38:43.640200 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:43.705539 (+ 65339us) service_pool.cc:227] Handling call
0807 13:38:43.705901 (+ 362us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:44.883281 (+1177380us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:44.899877 (+ 16596us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:44.900578 (+ 701us) log.cc:842] Serialized 26 byte log entry
0807 13:38:44.949206 (+ 48628us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:45.080882 (+131676us) log.cc:842] Serialized 14 byte log entry
0807 13:38:45.141733 (+ 60851us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:45.146077 (+ 4344us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:45.154164 (+ 8087us) raft_consensus.cc:1671] finished
0807 13:38:45.164182 (+ 10018us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:45.202547 (+ 38365us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":52939,"prepare.queue_time_us":539459,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":54928,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":23541,"thread_start_us":134373,"threads_started":2,"wal-append.queue_time_us":32118}
I20260807 13:38:45.581017 24429 raft_consensus.cc:686] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
W20260807 13:38:45.538053 23575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 164) took 1639 ms (client timeout 2041 ms). Trace:
I20260807 13:38:45.581933 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:45.582056 23575 rpcz_store.cc:269] 0807 13:38:43.896717 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:44.028083 (+131366us) service_pool.cc:227] Handling call
0807 13:38:45.265389 (+1237306us) spinlock_profiling.cc:243] Waited 5.69 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:45.535726 (+270337us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":13078784}
I20260807 13:38:45.582093 24429 consensus_queue.cc:237] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.583024 23478 raft_consensus.cc:2454] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:45.498737 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:45.583585 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:45.584209 23472 raft_consensus.cc:2354] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2.
I20260807 13:38:45.533823 24307 raft_consensus.cc:2781] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:45.585284 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:45.585834 24307 raft_consensus.cc:686] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:45.586851 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:45.457697 24347 raft_consensus.cc:504] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:45.588653 24490 log.cc:924] Time spent T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.673s user 0.001s sys 0.000s
I20260807 13:38:45.589237 24347 leader_election.cc:288] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:45.589483 24434 leader_election.cc:288] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:45.590031 23681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 329) took 1904 ms. Trace:
I20260807 13:38:45.590633 23674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 323) took 2051 ms. Trace:
I20260807 13:38:45.518061 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:45.590392 23681 rpcz_store.cc:276] 0807 13:38:43.685527 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:44.982837 (+1297310us) service_pool.cc:227] Handling call
0807 13:38:44.983255 (+ 418us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:44.984104 (+ 849us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:44.984136 (+ 32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:44.984437 (+ 301us) log.cc:842] Serialized 26 byte log entry
0807 13:38:45.049921 (+ 65484us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:38:45.049979 (+ 58us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:45.050080 (+ 101us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:45.589785 (+539705us) raft_consensus.cc:1671] finished
0807 13:38:45.589804 (+ 19us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:45.589963 (+ 159us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":891,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":1614,"thread_start_us":37923,"threads_started":1,"wal-append.queue_time_us":116657}
I20260807 13:38:45.592486 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:45.514514 23633 leader_election.cc:302] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
W20260807 13:38:45.594841 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 80495.8us
I20260807 13:38:45.597828 23633 leader_election.cc:302] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:45.567332 24497 leader_election.cc:288] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:45.564424 24489 raft_consensus.cc:482] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:45.569025 24334 leader_election.cc:288] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765), e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037)
I20260807 13:38:45.568895 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:45.593149 23681 raft_consensus.cc:2454] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:45.586910 24307 consensus_queue.cc:237] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.525766 24330 raft_consensus.cc:504] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.570464 24260 leader_election.cc:288] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:45.570981 23572 raft_consensus.cc:1261] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:45.459080 24485 consensus_queue.cc:1035] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260807 13:38:45.572499 24333 leader_election.cc:288] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:45.572836 24455 leader_election.cc:288] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:45.459124 24362 raft_consensus.cc:504] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.461088 24437 raft_consensus.cc:504] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.573872 24435 leader_election.cc:288] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:45.536222 24326 raft_consensus.cc:482] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:45.576937 24169 leader_election.cc:288] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:45.578012 24306 leader_election.cc:288] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:45.641860 23472 raft_consensus.cc:2379] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:45.580106 23581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 270) took 2476 ms. Trace:
I20260807 13:38:45.536370 24279 leader_election.cc:288] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:45.601177 23631 leader_election.cc:398] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Vote denied by peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037) with higher term. Message: Invalid argument: T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2.
I20260807 13:38:45.734093 23631 leader_election.cc:401] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:38:45.599519 23633 leader_election.cc:302] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
W20260807 13:38:45.735569 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 136147us
I20260807 13:38:45.705840 23480 raft_consensus.cc:2454] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:45.736629 23633 leader_election.cc:302] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:45.623549 24434 raft_consensus.cc:2781] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:45.507349 24458 raft_consensus.cc:504] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.585348 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:45.591804 23677 raft_consensus.cc:3037] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:45.572871 24450 leader_election.cc:288] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:45.591125 23674 rpcz_store.cc:276] 0807 13:38:43.539140 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:44.123522 (+584382us) service_pool.cc:227] Handling call
0807 13:38:44.136250 (+ 12728us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:44.229365 (+ 93115us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:44.235031 (+ 5666us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:44.259287 (+ 24256us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:44.278781 (+ 19494us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:45.590282 (+1311501us) spinlock_profiling.cc:243] Waited 46.1 ms on lock 0x7b54002c97d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:45.590330 (+ 48us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:45.590570 (+ 240us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":105916288}
I20260807 13:38:45.578642 24505 raft_consensus.cc:482] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:45.507817 24201 raft_consensus.cc:504] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.676842 23737 tablet_bootstrap.cc:492] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:45.630355 24487 raft_consensus.cc:482] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:45.630781 24497 raft_consensus.cc:3037] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:45.517182 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:45.733482 24455 raft_consensus.cc:482] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:45.636363 24347 raft_consensus.cc:482] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:45.630913 24489 raft_consensus.cc:504] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.565013 24356 consensus_queue.cc:260] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.750694 23737 ts_tablet_manager.cc:1397] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 1.696s user 0.059s sys 0.095s
W20260807 13:38:45.743422 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 289708us
I20260807 13:38:45.744531 24435 raft_consensus.cc:2726] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:38:45.742955 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:45.752655 24450 raft_consensus.cc:2726] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:45.762961 23575 raft_consensus.cc:2354] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 3. Current term is 4.
I20260807 13:38:45.754815 24434 raft_consensus.cc:686] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:45.700704 24326 raft_consensus.cc:504] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:45.799854 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 215945us
W20260807 13:38:45.802230 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 497171us
I20260807 13:38:45.756850 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:45.779170 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:45.784415 24435 raft_consensus.cc:3037] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 2
I20260807 13:38:45.757241 24487 raft_consensus.cc:504] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.753479 24505 raft_consensus.cc:504] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.760727 24455 raft_consensus.cc:504] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.765159 24347 raft_consensus.cc:504] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.793398 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:45.812273 23532 leader_election.cc:341] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:38:45.918632 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 106418us
I20260807 13:38:45.705386 23581 rpcz_store.cc:276] 0807 13:38:43.103711 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:43.111852 (+ 8141us) service_pool.cc:227] Handling call
0807 13:38:43.563537 (+451685us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ffbce 000000000034aea9 00007fc69cf2ba30 00007fc69cff17b4 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:38:43.563753 (+ 216us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:43.564145 (+ 392us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:43.564177 (+ 32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:43.564681 (+ 504us) log.cc:842] Serialized 26 byte log entry
0807 13:38:43.753915 (+189234us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:38:43.770916 (+ 17001us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:43.778949 (+ 8033us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:45.390211 (+1611262us) spinlock_profiling.cc:243] Waited 50 ms on lock 0x7b44000232cc. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc695049a95 00007fc69504a4b2 00007fc697cf2511 00007fc697cede1a 00007fc697ce1bee 00007fc697ce0f36 00007fc697ce0b58 00007fc697cea551 00007fc697cea509 00007fc697cea499
0807 13:38:45.579801 (+189590us) raft_consensus.cc:1671] finished
0807 13:38:45.579824 (+ 23us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:45.580001 (+ 177us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":10861,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":12839,"spinlock_wait_cycles":121277184,"thread_start_us":158940,"threads_started":1,"wal-append.queue_time_us":424643}
I20260807 13:38:45.812345 24450 raft_consensus.cc:482] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:45.914597 24530 raft_consensus.cc:482] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:45.920267 24450 raft_consensus.cc:504] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.920650 24530 raft_consensus.cc:504] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.921460 24489 leader_election.cc:288] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:45.921900 23740 tablet_bootstrap.cc:492] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:45.922437 23740 ts_tablet_manager.cc:1397] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.974s user 0.013s sys 0.021s
I20260807 13:38:45.922523 24450 leader_election.cc:288] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:45.922616 24201 leader_election.cc:288] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:45.919909 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:45.922721 24530 leader_election.cc:288] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:45.416261 23671 rpcz_store.cc:276] 0807 13:38:42.818911 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:43.611482 (+792571us) service_pool.cc:227] Handling call
0807 13:38:43.612038 (+ 556us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:43.895542 (+283504us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:43.895595 (+ 53us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:43.983842 (+ 88247us) log.cc:842] Serialized 26 byte log entry
0807 13:38:44.829894 (+846052us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:45.110196 (+280302us) log.cc:842] Serialized 14 byte log entry
0807 13:38:45.162746 (+ 52550us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:45.162825 (+ 79us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:45.162868 (+ 43us) raft_consensus.cc:1671] finished
0807 13:38:45.162883 (+ 15us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:45.300024 (+137141us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5638,"prepare.queue_time_us":174189,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":13599,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":1866,"thread_start_us":865834,"threads_started":2,"wal-append.queue_time_us":736745}
W20260807 13:38:45.924856 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 188161us
I20260807 13:38:45.796984 24356 raft_consensus.cc:3037] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:45.931264 23737 raft_consensus.cc:348] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.933934 23737 raft_consensus.cc:374] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:45.934254 23737 raft_consensus.cc:729] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:45.928989 23532 leader_election.cc:302] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:45.935104 23737 consensus_queue.cc:260] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.935694 24458 leader_election.cc:288] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
W20260807 13:38:45.875670 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 274674us
I20260807 13:38:45.937414 23631 leader_election.cc:302] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:45.926457 24330 leader_election.cc:288] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:45.940135 24458 raft_consensus.cc:482] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:45.940629 24437 leader_election.cc:288] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:45.940742 24458 raft_consensus.cc:504] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.943192 24458 leader_election.cc:288] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:45.944120 23633 leader_election.cc:302] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
W20260807 13:38:45.881069 24522 log.cc:924] Time spent T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.133s user 0.001s sys 0.000s
W20260807 13:38:45.880446 24526 log.cc:924] Time spent T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.067s user 0.000s sys 0.000s
I20260807 13:38:45.915225 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:45.881560 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:45.919225 24345 raft_consensus.cc:504] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:45.945457 23737 ts_tablet_manager.cc:1428] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.186s user 0.010s sys 0.000s
I20260807 13:38:45.949826 23633 leader_election.cc:398] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363) with higher term. Message: Invalid argument: T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 3. Current term is 4.
W20260807 13:38:46.091297 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 144863us
I20260807 13:38:46.135752 23681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 332) took 2046 ms. Trace:
I20260807 13:38:46.136399 23681 rpcz_store.cc:276] 0807 13:38:44.089402 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:45.638151 (+1548749us) service_pool.cc:227] Handling call
0807 13:38:45.638732 (+ 581us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:45.639181 (+ 449us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:45.639219 (+ 38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:45.643523 (+ 4304us) log.cc:842] Serialized 26 byte log entry
0807 13:38:45.865215 (+221692us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:45.865270 (+ 55us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:45.865380 (+ 110us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:46.039242 (+173862us) raft_consensus.cc:1671] finished
0807 13:38:46.039270 (+ 28us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:46.135682 (+ 96412us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":57984,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":35275,"thread_start_us":131929,"threads_started":1,"wal-append.queue_time_us":363762}
I20260807 13:38:45.811204 24309 raft_consensus.cc:482] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:46.140704 23739 tablet_bootstrap.cc:700] T 608f7e63bc4648e0890e5f601c52736c P e11cad1eeaf5424c94e51241096f6613: Time spent opening tablet: real 0.196s user 0.008s sys 0.004s
I20260807 13:38:46.135012 23633 leader_election.cc:401] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:38:45.814062 24205 raft_consensus.cc:482] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:45.894712 23674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 274) took 1678 ms. Trace:
I20260807 13:38:46.144120 23737 tablet_bootstrap.cc:492] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:45.934267 24315 raft_consensus.cc:3037] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:38:46.158277 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 208623us
I20260807 13:38:46.165412 23633 leader_election.cc:302] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:46.144009 23739 tablet_bootstrap.cc:654] T 608f7e63bc4648e0890e5f601c52736c P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:45.837237 24326 leader_election.cc:288] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:46.168854 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.035989 24330 raft_consensus.cc:2781] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:46.167860 23633 leader_election.cc:302] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:46.172063 23681 raft_consensus.cc:2454] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:45.980722 24497 raft_consensus.cc:2726] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:46.099993 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:45.994117 24201 raft_consensus.cc:2781] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:46.086048 23574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 279) took 2951 ms. Trace:
I20260807 13:38:45.870061 24260 consensus_queue.cc:1035] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.298s
I20260807 13:38:45.997185 24458 raft_consensus.cc:2726] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:38:45.945920 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.027004 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.187831 23684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 271) took 2482 ms. Trace:
I20260807 13:38:46.185662 23575 raft_consensus.cc:2354] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2.
W20260807 13:38:46.178908 23473 consensus_meta.cc:287] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.726s user 0.012s sys 0.000s
I20260807 13:38:46.195547 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.196895 23684 rpcz_store.cc:276] 0807 13:38:43.705243 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:44.998355 (+1293112us) service_pool.cc:227] Handling call
0807 13:38:44.998756 (+ 401us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:45.002480 (+ 3724us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:45.002525 (+ 45us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:45.033671 (+ 31146us) log.cc:842] Serialized 26 byte log entry
0807 13:38:45.634352 (+600681us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:45.634424 (+ 72us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:45.634528 (+ 104us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:46.187591 (+553063us) raft_consensus.cc:1671] finished
0807 13:38:46.187613 (+ 22us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:46.187775 (+ 162us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3093,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":40756,"thread_start_us":493719,"threads_started":1,"wal-append.queue_time_us":669382}
I20260807 13:38:46.035684 23573 raft_consensus.cc:2454] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:46.173491 24539 raft_consensus.cc:3037] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 4
I20260807 13:38:46.174748 24330 raft_consensus.cc:482] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:38:46.209947 24528 log.cc:924] Time spent T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.276s user 0.001s sys 0.000s
I20260807 13:38:46.192317 24326 raft_consensus.cc:2726] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:46.169303 24541 raft_consensus.cc:2726] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:46.187079 24510 raft_consensus.cc:482] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:46.203959 23469 raft_consensus.cc:2379] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:46.201378 23473 raft_consensus.cc:2454] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
I20260807 13:38:46.176292 24503 raft_consensus.cc:482] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:46.188571 24201 raft_consensus.cc:482] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:46.206303 23740 raft_consensus.cc:348] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.222934 23740 raft_consensus.cc:374] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:46.210325 24487 leader_election.cc:288] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:46.202315 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.223232 23740 raft_consensus.cc:729] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:45.927240 24434 consensus_queue.cc:237] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.167760 24205 raft_consensus.cc:504] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.161980 24309 raft_consensus.cc:504] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.223999 23740 consensus_queue.cc:260] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.205994 23475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 169) took 1212 ms. Trace:
I20260807 13:38:46.219208 23578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 159) took 2673 ms. Trace:
I20260807 13:38:46.198534 24364 raft_consensus.cc:482] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:46.217919 23633 leader_election.cc:398] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Vote denied by peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363) with higher term. Message: Invalid argument: T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2.
I20260807 13:38:46.194887 23671 raft_consensus.cc:2454] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:46.198385 24279 raft_consensus.cc:482] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:46.218885 23672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 319) took 2904 ms. Trace:
I20260807 13:38:46.201063 23572 raft_consensus.cc:2454] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:46.200428 24533 raft_consensus.cc:482] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:46.216467 24330 raft_consensus.cc:3037] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:46.223536 23684 raft_consensus.cc:2454] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:46.232442 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.233086 23684 raft_consensus.cc:2454] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:46.233928 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.234378 23684 raft_consensus.cc:2454] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:46.235080 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.235101 23633 leader_election.cc:302] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:46.161616 23674 rpcz_store.cc:276] 0807 13:38:44.285980 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:45.756179 (+1470199us) service_pool.cc:227] Handling call
0807 13:38:45.784334 (+ 28155us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:45.807715 (+ 23381us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:45.810473 (+ 2758us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:45.812562 (+ 2089us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:45.868141 (+ 55579us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:45.872094 (+ 3953us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:45.882312 (+ 10218us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:46.224174 24201 raft_consensus.cc:3037] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:46.238473 23740 ts_tablet_manager.cc:1428] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.316s user 0.007s sys 0.003s
I20260807 13:38:46.233484 24279 raft_consensus.cc:504] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.230984 23672 rpcz_store.cc:276] 0807 13:38:43.314303 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:44.069203 (+754900us) service_pool.cc:227] Handling call
0807 13:38:46.200965 (+2131762us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b5800004298. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:38:46.214732 (+ 13767us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:46.218580 (+ 3848us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:46.218784 (+ 204us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4967808}
I20260807 13:38:46.228045 23578 rpcz_store.cc:276] 0807 13:38:43.566042 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:44.878098 (+1312056us) service_pool.cc:227] Handling call
0807 13:38:44.900732 (+ 22634us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:45.065863 (+165131us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:46.218947 (+1153084us) spinlock_profiling.cc:243] Waited 56.9 ms on lock 0x7b5400386654. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:46.219140 (+ 193us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":130854784}
I20260807 13:38:46.244972 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.245230 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.246359 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.246640 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 298) took 1373 ms. Trace:
I20260807 13:38:46.231810 24364 raft_consensus.cc:504] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.233788 24505 leader_election.cc:288] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:46.249806 24364 leader_election.cc:288] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:46.250095 24475 log.cc:924] Time spent T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 1.909s user 0.004s sys 0.006s
I20260807 13:38:46.246986 23580 rpcz_store.cc:276] 0807 13:38:44.873044 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:45.508617 (+635573us) service_pool.cc:227] Handling call
0807 13:38:45.509093 (+ 476us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:45.566196 (+ 57103us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:45.566241 (+ 45us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:45.630974 (+ 64733us) log.cc:842] Serialized 26 byte log entry
0807 13:38:45.812998 (+182024us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:45.813058 (+ 60us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:46.246212 (+433154us) spinlock_profiling.cc:243] Waited 6.43 ms on lock 0x7b540020c1d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:46.246261 (+ 49us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:46.246309 (+ 48us) raft_consensus.cc:1671] finished
0807 13:38:46.246322 (+ 13us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:46.246581 (+ 259us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":29758,"raft.queue_time_us":26543,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":59922,"spinlock_wait_cycles":14780288,"thread_start_us":111879,"threads_started":1,"wal-append.queue_time_us":279051}
I20260807 13:38:46.237512 24533 raft_consensus.cc:504] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.240254 24444 leader_election.cc:288] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:46.267001 24435 raft_consensus.cc:2726] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election lost for term 1. Reason: Vote denied by peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037) with higher term. Message: Invalid argument: T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2.
I20260807 13:38:46.228593 24347 leader_election.cc:288] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:46.220041 24510 raft_consensus.cc:504] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.239542 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.229401 23677 raft_consensus.cc:2454] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4.
I20260807 13:38:46.238088 24326 raft_consensus.cc:2726] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:46.231197 24455 leader_election.cc:288] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:46.247514 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.223922 24503 raft_consensus.cc:504] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.281446 24309 leader_election.cc:288] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:46.284075 24503 leader_election.cc:288] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:46.288158 24539 raft_consensus.cc:2726] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363) with higher term. Message: Invalid argument: T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 3. Current term is 4.
I20260807 13:38:46.288558 24510 leader_election.cc:288] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:46.289340 23681 raft_consensus.cc:2454] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
I20260807 13:38:46.290642 24205 leader_election.cc:288] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:46.295931 24201 raft_consensus.cc:504] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.296602 24279 leader_election.cc:288] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:46.298072 24201 leader_election.cc:288] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:46.275812 24345 leader_election.cc:288] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:46.305677 24437 raft_consensus.cc:482] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:46.305550 24330 raft_consensus.cc:504] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.306241 24437 raft_consensus.cc:504] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.308043 24330 leader_election.cc:288] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:46.224538 23473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 343) took 1068 ms. Trace:
I20260807 13:38:46.339339 23473 rpcz_store.cc:276] 0807 13:38:45.154546 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:45.199158 (+ 44612us) service_pool.cc:227] Handling call
0807 13:38:46.222685 (+1023527us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:46.337924 23470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 315) took 2744 ms. Trace:
I20260807 13:38:46.225991 23475 rpcz_store.cc:276] 0807 13:38:44.988855 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:44.991276 (+ 2421us) service_pool.cc:227] Handling call
0807 13:38:45.076064 (+ 84788us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:45.267827 (+191763us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:45.267865 (+ 38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:45.268371 (+ 506us) log.cc:842] Serialized 26 byte log entry
0807 13:38:45.512432 (+244061us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:45.515409 (+ 2977us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:45.543564 (+ 28155us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:46.189730 (+646166us) raft_consensus.cc:1671] finished
0807 13:38:46.191706 (+ 1976us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:46.200747 (+ 9041us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13507,"raft.queue_time_us":156011,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":56639,"thread_start_us":235067,"threads_started":1,"wal-append.queue_time_us":429932}
I20260807 13:38:46.191987 23574 rpcz_store.cc:276] 0807 13:38:43.132616 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:43.699154 (+566538us) service_pool.cc:227] Handling call
0807 13:38:45.870719 (+2171565us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:38:45.895209 (+ 24490us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:45.923489 (+ 28280us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:45.926717 (+ 3228us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:45.930045 (+ 3328us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:45.945412 (+ 15367us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:45.996789 (+ 51377us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:46.084080 (+ 87291us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":44206336}
I20260807 13:38:46.351743 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.354535 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.354885 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 342) took 1206 ms. Trace:
I20260807 13:38:46.246997 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.357422 23578 raft_consensus.cc:2379] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 3: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:46.358909 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "608f7e63bc4648e0890e5f601c52736c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:46.364006 23571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 265) took 3268 ms (client timeout 2884 ms). Trace:
I20260807 13:38:46.364444 23479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 337) took 1308 ms. Trace:
W20260807 13:38:46.391037 23407 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:38:46.364955 23479 rpcz_store.cc:276] 0807 13:38:45.056341 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:45.056492 (+ 151us) service_pool.cc:227] Handling call
0807 13:38:45.435198 (+378706us) spinlock_profiling.cc:243] Waited 9.8 ms on lock 0x7b5800003398. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:38:45.449540 (+ 14342us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:45.501169 (+ 51629us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:46.363933 (+862764us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b540011e250. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ea09 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:46.364204 (+ 271us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":54971008}
I20260807 13:38:46.274873 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:46.442121 23672 raft_consensus.cc:2454] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:46.444484 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.384413 23582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 285) took 3000 ms. Trace:
I20260807 13:38:46.446386 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.444382 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b078a19f38494b04ad11b14d98ec4bca" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.355297 23480 rpcz_store.cc:276] 0807 13:38:45.148403 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:45.307972 (+159569us) service_pool.cc:227] Handling call
0807 13:38:46.354408 (+1046436us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b540009ecd4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:46.354662 (+ 254us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":662194432}
I20260807 13:38:46.424707 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.415372 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.392027 23577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 292) took 2724 ms. Trace:
W20260807 13:38:46.364883 23571 rpcz_store.cc:269] 0807 13:38:43.095343 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:43.097374 (+ 2031us) service_pool.cc:227] Handling call
0807 13:38:46.363332 (+3265958us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b540024e0d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:46.363656 (+ 324us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":832438656}
I20260807 13:38:46.367082 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.373796 23471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 335) took 1369 ms. Trace:
I20260807 13:38:46.392454 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.383072 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.369410 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.423440 23633 leader_election.cc:302] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:46.446180 23582 rpcz_store.cc:276] 0807 13:38:43.383753 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:44.075831 (+692078us) service_pool.cc:227] Handling call
0807 13:38:44.689254 (+613423us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:44.756454 (+ 67200us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:46.383779 (+1627325us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b5400377650. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ea09 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:46.384137 (+ 358us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1404035840}
I20260807 13:38:46.275588 23677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57122 (request call id 289) took 1071 ms. Trace:
I20260807 13:38:46.461994 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.463506 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:46.463919 24205 raft_consensus.cc:482] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:46.410310 23342 catalog_manager.cc:5495] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a reported cstate change: term changed from 1 to 2, leader changed from 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2) to 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3). New cstate: current_term: 2 leader_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: HEALTHY } } }
I20260807 13:38:46.465104 24205 raft_consensus.cc:504] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.466166 23677 rpcz_store.cc:276] 0807 13:38:45.202032 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:45.455990 (+253958us) service_pool.cc:227] Handling call
0807 13:38:46.273387 (+817397us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:46.467588 24434 raft_consensus.cc:482] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:46.467980 23346 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41376 (request call id 63) took 4321 ms. Trace:
I20260807 13:38:46.468520 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.468940 24455 raft_consensus.cc:482] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:46.469808 24455 raft_consensus.cc:504] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.470260 23679 raft_consensus.cc:1226] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:38:46.454537 23577 rpcz_store.cc:276] 0807 13:38:43.667397 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:44.967612 (+1300215us) service_pool.cc:227] Handling call
0807 13:38:44.967991 (+ 379us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:44.989625 (+ 21634us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:44.991578 (+ 1953us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:44.998301 (+ 6723us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:45.000779 (+ 2478us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:46.391534 (+1390755us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b5400377154. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:46.391598 (+ 64us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:46.391839 (+ 241us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":35690880}
I20260807 13:38:46.471300 23679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 321) took 3105 ms. Trace:
I20260807 13:38:46.471434 23739 tablet_bootstrap.cc:492] T 608f7e63bc4648e0890e5f601c52736c P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:46.475114 24450 consensus_queue.cc:1035] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:46.475342 24510 consensus_queue.cc:1035] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:38:46.477583 24503 consensus_queue.cc:1035] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:46.478338 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.479404 23684 raft_consensus.cc:2454] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:46.480728 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:46.480990 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 58042.5us
I20260807 13:38:46.481962 23684 raft_consensus.cc:2454] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:46.480790 23342 catalog_manager.cc:5495] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a reported cstate change: term changed from 1 to 2, leader changed from 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2) to e11cad1eeaf5424c94e51241096f6613 (127.21.69.1). New cstate: current_term: 2 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } }
I20260807 13:38:46.472292 23679 rpcz_store.cc:276] 0807 13:38:43.366070 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:46.468946 (+3102876us) service_pool.cc:227] Handling call
0807 13:38:46.469586 (+ 640us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:46.470886 (+ 1300us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:46.471169 (+ 283us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:46.487875 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:46.341611 23470 rpcz_store.cc:276] 0807 13:38:43.593444 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:43.634065 (+ 40621us) service_pool.cc:227] Handling call
0807 13:38:43.670357 (+ 36292us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:43.701682 (+ 31325us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:43.701714 (+ 32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:43.702254 (+ 540us) log.cc:842] Serialized 26 byte log entry
0807 13:38:44.027509 (+325255us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:44.028401 (+ 892us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:44.063610 (+ 35209us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:46.249488 (+2185878us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b44000232cc. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc695049a95 00007fc69504a4b2 00007fc697cf2511 00007fc697cede1a 00007fc697ce1bee 00007fc697ce0f36 00007fc697ce0b58 00007fc697cea551 00007fc697cea509 00007fc697cea499
0807 13:38:46.336241 (+ 86753us) raft_consensus.cc:1671] finished
0807 13:38:46.336345 (+ 104us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:46.337336 (+ 991us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2171,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":125,"spinlock_wait_cycles":8151296,"thread_start_us":324845,"threads_started":1,"wal-append.queue_time_us":435080}
I20260807 13:38:46.468566 24434 raft_consensus.cc:504] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.491074 24330 raft_consensus.cc:482] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:46.491290 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.487942 24450 raft_consensus.cc:2781] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:46.492130 24330 raft_consensus.cc:504] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.455974 23471 rpcz_store.cc:276] 0807 13:38:45.003840 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:46.371869 (+1368029us) service_pool.cc:227] Handling call
0807 13:38:46.372712 (+ 843us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:46.373168 (+ 456us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:46.373221 (+ 53us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:46.373267 (+ 46us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:46.373330 (+ 63us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:46.373438 (+ 108us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:46.373585 (+ 147us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:46.493547 23574 raft_consensus.cc:2454] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:38:46.493278 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.495244 23573 raft_consensus.cc:2454] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:46.498838 24455 leader_election.cc:288] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:46.504673 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.506404 23675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 263) took 2989 ms. Trace:
I20260807 13:38:46.507481 24434 leader_election.cc:288] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:46.508128 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.508978 23672 raft_consensus.cc:2454] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:46.498955 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.499998 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:46.500998 24493 consensus_queue.cc:1035] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:46.509791 24348 raft_consensus.cc:3032] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:46.519929 24348 raft_consensus.cc:729] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:46.509173 23342 catalog_manager.cc:5495] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a reported cstate change: term changed from 3 to 4, leader changed from 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2) to 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3). New cstate: current_term: 4 leader_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: HEALTHY } } }
I20260807 13:38:46.514360 24315 raft_consensus.cc:482] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:46.514670 23581 raft_consensus.cc:2379] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 2: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:46.506912 23675 rpcz_store.cc:276] 0807 13:38:43.550815 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:45.573627 (+2022812us) service_pool.cc:227] Handling call
0807 13:38:45.574091 (+ 464us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:45.706647 (+132556us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:45.739401 (+ 32754us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:45.741242 (+ 1841us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:45.742903 (+ 1661us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:46.505842 (+762939us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b5400040e54. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:46.505925 (+ 83us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:46.506159 (+ 234us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":229920000}
I20260807 13:38:46.516040 23737 tablet_bootstrap.cc:654] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:46.516568 24169 raft_consensus.cc:482] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:46.518049 23676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 315) took 3403 ms. Trace:
I20260807 13:38:46.521267 23571 raft_consensus.cc:2454] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:46.494275 24450 raft_consensus.cc:482] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:46.521701 24348 consensus_queue.cc:260] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.513031 23739 ts_tablet_manager.cc:1397] T 608f7e63bc4648e0890e5f601c52736c P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 1.112s user 0.030s sys 0.007s
I20260807 13:38:46.523871 23633 leader_election.cc:302] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:46.468573 23346 rpcz_store.cc:276] 0807 13:38:42.134177 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:42.134483 (+ 306us) service_pool.cc:227] Handling call
0807 13:38:46.453244 (+4318761us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:38:42.487527 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:38:42.489799 (+ 2272us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:38:42.489845 (+ 46us) write_op.cc:435] Acquired schema lock
0807 13:38:42.489867 (+ 22us) tablet.cc:660] Decoding operations
0807 13:38:42.490543 (+ 676us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:38:42.490631 (+ 88us) write_op.cc:641] Partition lock acquired for write op
0807 13:38:42.490660 (+ 29us) tablet.cc:683] Acquiring locks for 4 operations
0807 13:38:42.491096 (+ 436us) tablet.cc:699] Row locks acquired
0807 13:38:42.491113 (+ 17us) write_op.cc:260] PREPARE: finished
0807 13:38:42.491277 (+ 164us) write_op.cc:270] Start()
0807 13:38:42.491406 (+ 129us) write_op.cc:276] Timestamp: P: 1786109922491226 usec, L: 0
0807 13:38:42.491431 (+ 25us) op_driver.cc:331] REPLICATION: starting
0807 13:38:42.525554 (+ 34123us) log.cc:842] Serialized 1681 byte log entry
0807 13:38:43.081174 (+555620us) op_driver.cc:444] REPLICATION: finished
0807 13:38:43.216408 (+135234us) write_op.cc:301] APPLY: starting
0807 13:38:43.221770 (+ 5362us) tablet.cc:1365] starting BulkCheckPresence
0807 13:38:43.252840 (+ 31070us) tablet.cc:1368] finished BulkCheckPresence
0807 13:38:43.263123 (+ 10283us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:38:43.263851 (+ 728us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:38:43.267540 (+ 3689us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0807 13:38:43.267592 (+ 52us) write_op.cc:312] APPLY: finished
0807 13:38:43.267937 (+ 345us) log.cc:842] Serialized 40 byte log entry
0807 13:38:43.268126 (+ 189us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:38:43.268248 (+ 122us) write_op.cc:454] Released schema lock
0807 13:38:43.268297 (+ 49us) write_op.cc:341] FINISH: Updating metrics
0807 13:38:43.268556 (+ 259us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:38:43.268599 (+ 43us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":108587,"apply.run_cpu_time_us":3285,"apply.run_wall_time_us":72745,"num_ops":4,"prepare.queue_time_us":80097,"prepare.run_cpu_time_us":9887,"prepare.run_wall_time_us":153361,"raft.queue_time_us":198693,"raft.run_cpu_time_us":34468,"raft.run_wall_time_us":60180,"replication_time_us":589639,"thread_start_us":320903,"threads_started":4,"wal-append.queue_time_us":129000,"wal-append.run_cpu_time_us":41698,"wal-append.run_wall_time_us":1592726}]]}
I20260807 13:38:46.538257 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.495872 23671 raft_consensus.cc:2454] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:46.569653 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:46.570546 23342 catalog_manager.cc:5495] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a reported cstate change: term changed from 1 to 2, leader changed from 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2) to 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3). New cstate: current_term: 2 leader_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: HEALTHY } } }
I20260807 13:38:46.525700 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.564697 24450 raft_consensus.cc:3037] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:46.575861 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.595824 24461 raft_consensus.cc:482] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:46.596208 24348 raft_consensus.cc:3037] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:38:46.596516 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 72992.2us
I20260807 13:38:46.597134 23571 raft_consensus.cc:2396] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:38:46.596681 24461 raft_consensus.cc:504] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:46.600654 24556 log.cc:924] Time spent T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.081s user 0.001s sys 0.000s
I20260807 13:38:46.601063 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:46.599298 24461 leader_election.cc:288] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:46.594319 23684 raft_consensus.cc:2454] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:46.587663 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.608915 23631 leader_election.cc:302] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:46.588024 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:46.610270 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:46.612221 24539 raft_consensus.cc:482] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:46.613078 24326 raft_consensus.cc:482] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:46.619411 24330 leader_election.cc:288] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:46.592633 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.625842 24326 raft_consensus.cc:504] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.626719 23575 raft_consensus.cc:2454] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:38:46.628085 24539 raft_consensus.cc:504] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.628372 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.629061 24362 leader_election.cc:288] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:46.629578 23575 raft_consensus.cc:2454] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:46.613301 23740 tablet_bootstrap.cc:492] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:46.613771 24435 raft_consensus.cc:482] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:46.632457 24435 raft_consensus.cc:504] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.633960 24533 leader_election.cc:288] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:46.634950 24435 leader_election.cc:288] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:46.606161 24434 raft_consensus.cc:2726] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:46.636827 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "356c6b3e51454d418acaa9be70bb9689" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.637980 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.638200 23631 leader_election.cc:302] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:46.621557 23578 raft_consensus.cc:2454] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:46.638911 23580 raft_consensus.cc:2454] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:46.639249 23578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 175) took 1088 ms. Trace:
I20260807 13:38:46.538333 23676 rpcz_store.cc:276] 0807 13:38:43.114442 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:43.359610 (+245168us) service_pool.cc:227] Handling call
0807 13:38:43.421182 (+ 61572us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:44.968239 (+1547057us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:46.517504 (+1549265us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54003692d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:46.517808 (+ 304us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2731554048}
I20260807 13:38:46.640688 23675 raft_consensus.cc:2454] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:46.623381 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:46.643144 24518 log.cc:924] Time spent T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.766s user 0.002s sys 0.000s
I20260807 13:38:46.624855 23429 leader_election.cc:302] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:46.639609 23578 rpcz_store.cc:276] 0807 13:38:45.551232 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:46.454874 (+903642us) service_pool.cc:227] Handling call
0807 13:38:46.639169 (+184295us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:46.622453 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:46.643922 23674 raft_consensus.cc:2354] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 2. Current term is 3.
I20260807 13:38:46.623925 24530 raft_consensus.cc:482] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:46.645994 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:46.584575 24315 raft_consensus.cc:504] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:46.688954 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 68473.3us
I20260807 13:38:46.594327 24205 leader_election.cc:288] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:46.602344 24169 raft_consensus.cc:504] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:46.742249 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 104139us
I20260807 13:38:46.689478 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:46.752804 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:46.755590 24557 log.cc:924] Time spent T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.060s user 0.001s sys 0.000s
I20260807 13:38:46.728570 23480 raft_consensus.cc:2454] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
W20260807 13:38:46.740473 24558 log.cc:924] Time spent T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.125s user 0.001s sys 0.000s
I20260807 13:38:46.695662 24362 raft_consensus.cc:2781] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:46.754279 23469 raft_consensus.cc:2379] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 1: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:46.695072 24330 raft_consensus.cc:2726] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:46.769403 24519 raft_consensus.cc:482] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:46.767334 24362 raft_consensus.cc:482] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:46.768011 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.771155 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faff067df57c4de49e89824bbc248751" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.700825 24435 raft_consensus.cc:3037] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:46.778376 24326 leader_election.cc:288] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:46.779431 23739 raft_consensus.cc:348] T 608f7e63bc4648e0890e5f601c52736c P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.782666 23739 raft_consensus.cc:374] T 608f7e63bc4648e0890e5f601c52736c P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:46.763674 24539 leader_election.cc:288] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:46.783026 23739 raft_consensus.cc:729] T 608f7e63bc4648e0890e5f601c52736c P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:46.768133 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.788028 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.782737 23679 raft_consensus.cc:2454] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:46.789819 23739 consensus_queue.cc:260] T 608f7e63bc4648e0890e5f601c52736c P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.781554 24362 raft_consensus.cc:3037] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:46.795405 23581 raft_consensus.cc:2379] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 1: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:46.796681 24519 raft_consensus.cc:504] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.799140 24519 leader_election.cc:288] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:46.732460 24530 raft_consensus.cc:504] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.817188 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.791733 23470 raft_consensus.cc:2454] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:46.825049 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.827538 23580 raft_consensus.cc:2454] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:38:46.827734 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.829288 23684 raft_consensus.cc:2454] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:46.829476 23429 leader_election.cc:302] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:46.823125 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:46.827097 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:46.837062 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.849565 24169 leader_election.cc:288] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:46.850400 24169 raft_consensus.cc:2781] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:46.850781 24169 raft_consensus.cc:482] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:46.851179 24169 raft_consensus.cc:3037] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:46.852135 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:46.852720 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:46.853093 23574 raft_consensus.cc:2362] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3. Re-sending same reply.
I20260807 13:38:46.853508 23571 raft_consensus.cc:3037] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:46.855098 23574 raft_consensus.cc:1226] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:46.856086 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:46.856333 23680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 262) took 3428 ms. Trace:
I20260807 13:38:46.856706 23680 rpcz_store.cc:276] 0807 13:38:43.459739 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:43.942683 (+482944us) service_pool.cc:227] Handling call
0807 13:38:46.498813 (+2556130us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b5800004298. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:38:46.499165 (+ 352us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:46.499876 (+ 711us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:46.499933 (+ 57us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:46.500762 (+ 829us) log.cc:842] Serialized 26 byte log entry
0807 13:38:46.587545 (+ 86783us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:38:46.587630 (+ 85us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:46.592128 (+ 4498us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:46.828184 (+236056us) raft_consensus.cc:1671] finished
0807 13:38:46.829821 (+ 1637us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:46.856164 (+ 26343us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2347,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":379,"spinlock_wait_cycles":14694656,"thread_start_us":77886,"threads_started":1,"wal-append.queue_time_us":90083}
I20260807 13:38:46.837843 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.858820 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4996c3c52ccc41b9a8da11ca747a8e6a" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.859026 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:46.859333 23580 raft_consensus.cc:2454] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:38:46.860823 23580 raft_consensus.cc:1261] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:46.861423 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 302) took 1901 ms. Trace:
I20260807 13:38:46.862025 23582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 303) took 1901 ms. Trace:
I20260807 13:38:46.862440 23582 rpcz_store.cc:276] 0807 13:38:44.960507 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:46.860241 (+1899734us) service_pool.cc:227] Handling call
0807 13:38:46.860637 (+ 396us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:46.861427 (+ 790us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:46.861498 (+ 71us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:46.861616 (+ 118us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:46.861698 (+ 82us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:46.861793 (+ 95us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:46.861962 (+ 169us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:46.861753 23580 rpcz_store.cc:276] 0807 13:38:44.960185 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:46.860101 (+1899916us) service_pool.cc:227] Handling call
0807 13:38:46.860470 (+ 369us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:46.861162 (+ 692us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:46.861344 (+ 182us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:46.862869 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "356c6b3e51454d418acaa9be70bb9689" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.868144 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.904840 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
W20260807 13:38:46.871073 23533 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.69.3:36765 timed out after 1.566s (SENT) [suppressed 5 similar messages]
W20260807 13:38:46.912847 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 89964us
I20260807 13:38:46.913152 23581 raft_consensus.cc:2396] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for term 3 because replica has last-logged OpId of term: 2 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:38:46.914958 23739 ts_tablet_manager.cc:1428] T 608f7e63bc4648e0890e5f601c52736c P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.341s user 0.014s sys 0.012s
I20260807 13:38:46.906390 23573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 170) took 1357 ms. Trace:
I20260807 13:38:46.916325 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:46.873546 23574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 301) took 1993 ms. Trace:
I20260807 13:38:46.924576 23429 leader_election.cc:302] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
W20260807 13:38:46.925369 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 50509.8us
I20260807 13:38:46.927103 23740 tablet_bootstrap.cc:654] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:46.927058 23429 leader_election.cc:302] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters: 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:46.927966 24279 raft_consensus.cc:2781] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:46.928355 24279 raft_consensus.cc:482] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:46.928972 24279 raft_consensus.cc:3037] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:46.930014 23737 tablet_bootstrap.cc:492] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:46.930730 23737 ts_tablet_manager.cc:1397] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.787s user 0.014s sys 0.015s
I20260807 13:38:46.873708 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faff067df57c4de49e89824bbc248751" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:46.923076 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.932408 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:46.931241 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.937233 23684 raft_consensus.cc:2454] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:46.876236 23674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57122 (request call id 294) took 1093 ms. Trace:
I20260807 13:38:46.876430 24450 raft_consensus.cc:504] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.939543 24434 raft_consensus.cc:482] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:46.928973 23575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 299) took 2055 ms. Trace:
I20260807 13:38:46.941272 23681 raft_consensus.cc:2454] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:46.948134 23674 rpcz_store.cc:276] 0807 13:38:45.782831 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:46.784108 (+1001277us) service_pool.cc:227] Handling call
0807 13:38:46.874143 (+ 90035us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:46.948642 24315 leader_election.cc:288] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:46.950538 24434 raft_consensus.cc:504] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:46.952332 23739 tablet_bootstrap.cc:492] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:46.923810 23574 rpcz_store.cc:276] 0807 13:38:44.873977 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:46.854131 (+1980154us) service_pool.cc:227] Handling call
0807 13:38:46.854724 (+ 593us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:46.855561 (+ 837us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:46.867385 (+ 11824us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:38:46.954945 23429 leader_election.cc:341] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:46.955819 23429 leader_election.cc:302] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:46.955853 23571 raft_consensus.cc:2454] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:38:46.957300 23581 raft_consensus.cc:1261] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:46.957602 23571 raft_consensus.cc:1261] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:46.957980 24306 raft_consensus.cc:2781] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:46.958316 23571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 313) took 1085 ms. Trace:
I20260807 13:38:46.958385 24306 raft_consensus.cc:482] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:46.959046 24306 raft_consensus.cc:3037] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:46.959829 23575 rpcz_store.cc:276] 0807 13:38:44.873425 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:46.868954 (+1995529us) service_pool.cc:227] Handling call
0807 13:38:46.928067 (+ 59113us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:46.928314 (+ 247us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:46.928342 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:46.928402 (+ 60us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:46.928444 (+ 42us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:46.928731 (+ 287us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:46.928875 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:46.961894 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.962791 23681 raft_consensus.cc:2454] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:46.963960 23680 raft_consensus.cc:2454] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:46.922179 23573 rpcz_store.cc:276] 0807 13:38:45.549532 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:46.871170 (+1321638us) service_pool.cc:227] Handling call
0807 13:38:46.906260 (+ 35090us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:46.930756 24362 raft_consensus.cc:504] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.101401 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:47.116781 23684 raft_consensus.cc:2454] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:47.117604 23684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57122 (request call id 291) took 1361 ms. Trace:
I20260807 13:38:47.119778 23684 rpcz_store.cc:276] 0807 13:38:45.756100 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:47.020245 (+1264145us) service_pool.cc:227] Handling call
0807 13:38:47.117527 (+ 97282us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:47.122841 23581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 307) took 1815 ms. Trace:
I20260807 13:38:46.967718 23571 rpcz_store.cc:276] 0807 13:38:45.873468 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:46.956789 (+1083321us) service_pool.cc:227] Handling call
0807 13:38:46.957204 (+ 415us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:46.958012 (+ 808us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:46.958237 (+ 225us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:47.124105 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "356c6b3e51454d418acaa9be70bb9689" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:47.125949 23737 raft_consensus.cc:348] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.128115 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:47.134500 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:47.129525 24565 log.cc:924] Time spent T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.424s user 0.002s sys 0.000s
I20260807 13:38:47.130822 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:47.131959 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:47.128625 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4996c3c52ccc41b9a8da11ca747a8e6a" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:47.134968 23737 raft_consensus.cc:374] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260807 13:38:47.041241 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 151664us
I20260807 13:38:47.073786 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:46.967993 24485 raft_consensus.cc:2781] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:38:47.135242 23581 rpcz_store.cc:276] 0807 13:38:45.301899 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:46.940787 (+1638888us) service_pool.cc:227] Handling call
0807 13:38:46.956820 (+ 16033us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:46.957664 (+ 844us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:47.117250 (+159586us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:46.956434 23574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 308) took 1654 ms. Trace:
I20260807 13:38:46.954275 24437 leader_election.cc:288] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:47.119272 24434 leader_election.cc:288] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:47.142294 23737 raft_consensus.cc:729] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
W20260807 13:38:47.135820 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 179011us
I20260807 13:38:46.968940 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:46.968935 23582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 304) took 1994 ms. Trace:
I20260807 13:38:46.971417 23478 raft_consensus.cc:2454] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:47.120680 24530 leader_election.cc:288] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:47.145220 23481 raft_consensus.cc:3037] T 608f7e63bc4648e0890e5f601c52736c P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:47.073724 24306 raft_consensus.cc:504] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.149564 23737 consensus_queue.cc:260] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.151858 23473 raft_consensus.cc:2454] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:47.156226 23681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 275) took 2829 ms. Trace:
I20260807 13:38:47.161485 23681 rpcz_store.cc:276] 0807 13:38:44.529386 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:46.963662 (+2434276us) service_pool.cc:227] Handling call
0807 13:38:47.152947 (+189285us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:47.157769 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:47.147825 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:47.148387 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:47.149785 24435 raft_consensus.cc:2726] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:47.163827 23581 raft_consensus.cc:3032] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:38:47.147547 23574 rpcz_store.cc:276] 0807 13:38:45.302247 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:46.955247 (+1653000us) service_pool.cc:227] Handling call
0807 13:38:46.955700 (+ 453us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:46.956021 (+ 321us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:46.956050 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:46.956124 (+ 74us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:46.956168 (+ 44us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:46.956245 (+ 77us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:46.956364 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:47.162133 23470 raft_consensus.cc:2454] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:47.154028 24485 raft_consensus.cc:686] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 4 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:47.169795 23684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 277) took 2366 ms. Trace:
I20260807 13:38:47.167060 24434 raft_consensus.cc:482] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:47.173158 23737 ts_tablet_manager.cc:1428] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.242s user 0.008s sys 0.003s
I20260807 13:38:47.151858 23471 raft_consensus.cc:2454] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:47.169036 23429 leader_election.cc:302] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:47.172096 23581 raft_consensus.cc:729] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:47.176407 24315 raft_consensus.cc:482] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:47.176594 23573 raft_consensus.cc:1261] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:47.189009 23573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 323) took 1185 ms. Trace:
I20260807 13:38:47.188704 24315 raft_consensus.cc:504] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.189463 23573 rpcz_store.cc:276] 0807 13:38:46.003422 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:47.136669 (+1133247us) service_pool.cc:227] Handling call
0807 13:38:47.172388 (+ 35719us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:47.188675 (+ 16287us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:47.188935 (+ 260us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:47.153889 23582 rpcz_store.cc:276] 0807 13:38:44.974938 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:46.864049 (+1889111us) service_pool.cc:227] Handling call
0807 13:38:46.932768 (+ 68719us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:46.968389 (+ 35621us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:46.968433 (+ 44us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:46.968494 (+ 61us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:46.968546 (+ 52us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:46.968633 (+ 87us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:46.968834 (+ 201us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:47.176528 23674 raft_consensus.cc:2454] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:47.176904 24437 raft_consensus.cc:482] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:47.192641 23737 tablet_bootstrap.cc:492] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:47.192404 24437 raft_consensus.cc:504] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.193081 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:47.194443 23571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 324) took 1039 ms. Trace:
I20260807 13:38:47.194114 23674 raft_consensus.cc:2454] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:47.194751 24437 leader_election.cc:288] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:47.155887 23577 raft_consensus.cc:2454] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:38:47.194869 23571 rpcz_store.cc:276] 0807 13:38:46.155583 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:47.148642 (+993059us) service_pool.cc:227] Handling call
0807 13:38:47.193809 (+ 45167us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:47.194075 (+ 266us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:47.194100 (+ 25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:47.194166 (+ 66us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:47.194204 (+ 38us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:47.194264 (+ 60us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:47.194381 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:47.195519 23577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 322) took 1282 ms. Trace:
I20260807 13:38:47.195924 23577 rpcz_store.cc:276] 0807 13:38:45.912790 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:47.090270 (+1177480us) service_pool.cc:227] Handling call
0807 13:38:47.195453 (+105183us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:47.178226 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:47.174279 23572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 178) took 1620 ms. Trace:
I20260807 13:38:47.181994 23684 rpcz_store.cc:276] 0807 13:38:44.815515 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:47.136408 (+2320893us) service_pool.cc:227] Handling call
0807 13:38:47.161295 (+ 24887us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:47.161470 (+ 175us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:47.161494 (+ 24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:47.165814 (+ 4320us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:47.165862 (+ 48us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:47.165921 (+ 59us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:47.166039 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:47.191622 24315 leader_election.cc:288] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:47.200112 23676 raft_consensus.cc:2454] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:47.206415 23739 tablet_bootstrap.cc:654] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:47.200012 24279 raft_consensus.cc:504] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.202718 24507 raft_consensus.cc:482] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:47.196900 23572 rpcz_store.cc:276] 0807 13:38:45.566857 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:47.131604 (+1564747us) service_pool.cc:227] Handling call
0807 13:38:47.172671 (+ 41067us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:47.196616 23674 raft_consensus.cc:1261] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260807 13:38:47.211077 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 60771.1us
I20260807 13:38:47.209484 23671 raft_consensus.cc:2379] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 3: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
W20260807 13:38:47.215731 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 68076us
I20260807 13:38:47.218941 23633 leader_election.cc:302] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:47.210413 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:47.219304 24485 consensus_queue.cc:237] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.224397 23469 raft_consensus.cc:2379] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:47.221757 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:47.229579 23429 leader_election.cc:341] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:47.224947 23532 leader_election.cc:302] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:47.201550 24169 raft_consensus.cc:504] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.232280 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:47.236198 23684 raft_consensus.cc:1261] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:47.220867 23581 consensus_queue.cc:260] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.210940 24434 raft_consensus.cc:504] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.224885 23671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57122 (request call id 292) took 1457 ms. Trace:
I20260807 13:38:47.240149 24330 raft_consensus.cc:2726] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:47.254222 24573 raft_consensus.cc:2781] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:47.211951 24507 raft_consensus.cc:504] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.229260 23674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 278) took 2344 ms. Trace:
I20260807 13:38:47.261237 23681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 279) took 2329 ms. Trace:
I20260807 13:38:47.261804 23681 rpcz_store.cc:276] 0807 13:38:44.944257 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:47.197096 (+2252839us) service_pool.cc:227] Handling call
0807 13:38:47.223760 (+ 26664us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:47.260774 (+ 37014us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:47.260816 (+ 42us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:47.260876 (+ 60us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:47.260908 (+ 32us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:47.260988 (+ 80us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:47.261161 (+ 173us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:47.264050 24417 consensus_queue.cc:1046] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260807 13:38:47.239555 23684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 280) took 2263 ms. Trace:
I20260807 13:38:47.265511 23684 rpcz_store.cc:276] 0807 13:38:44.975954 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:47.208635 (+2232681us) service_pool.cc:227] Handling call
0807 13:38:47.225171 (+ 16536us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:47.239332 (+ 14161us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:47.239510 (+ 178us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:38:47.268208 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 49516.8us
I20260807 13:38:47.240370 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:47.276921 23429 leader_election.cc:302] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:47.259778 24573 raft_consensus.cc:482] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:38:47.273741 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 59218.3us
I20260807 13:38:47.235956 24362 leader_election.cc:288] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:47.281787 24315 raft_consensus.cc:2781] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:47.294381 24315 raft_consensus.cc:482] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:47.294868 24315 raft_consensus.cc:3037] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:47.288712 23429 leader_election.cc:302] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:47.278113 23572 raft_consensus.cc:2454] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
W20260807 13:38:47.303828 24575 log.cc:924] Time spent T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.081s user 0.001s sys 0.000s
I20260807 13:38:47.304080 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:47.304507 24279 leader_election.cc:288] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:47.305089 23675 raft_consensus.cc:2379] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:47.283741 24573 raft_consensus.cc:3037] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:47.266830 23674 rpcz_store.cc:276] 0807 13:38:44.908434 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:47.195380 (+2286946us) service_pool.cc:227] Handling call
0807 13:38:47.196210 (+ 830us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:47.212378 (+ 16168us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:47.223218 (+ 10840us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:47.300333 24345 raft_consensus.cc:2781] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:47.289969 24306 leader_election.cc:288] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:47.259050 23671 rpcz_store.cc:276] 0807 13:38:45.767920 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:46.932112 (+1164192us) service_pool.cc:227] Handling call
0807 13:38:47.224339 (+292227us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:47.321511 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 305) took 2330 ms. Trace:
I20260807 13:38:47.303078 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9fcdd060ef64874a8719c95b2325942" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:47.325275 23684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 287) took 2179 ms. Trace:
I20260807 13:38:47.325824 23684 rpcz_store.cc:276] 0807 13:38:45.145846 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:47.271191 (+2125345us) service_pool.cc:227] Handling call
0807 13:38:47.293740 (+ 22549us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:47.299132 (+ 5392us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:47.299163 (+ 31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:47.324977 (+ 25814us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:47.325020 (+ 43us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:47.325084 (+ 64us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:47.325221 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:47.324694 23633 leader_election.cc:302] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:47.324375 23580 rpcz_store.cc:276] 0807 13:38:44.975281 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:46.864720 (+1889439us) service_pool.cc:227] Handling call
0807 13:38:46.865121 (+ 401us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:46.865982 (+ 861us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:46.866016 (+ 34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:46.866834 (+ 818us) log.cc:842] Serialized 26 byte log entry
0807 13:38:46.975830 (+108996us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:46.975883 (+ 53us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:46.975971 (+ 88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:47.305569 (+329598us) raft_consensus.cc:1671] finished
0807 13:38:47.305590 (+ 21us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:47.305718 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":133,"thread_start_us":108452,"threads_started":1,"wal-append.queue_time_us":304859}
I20260807 13:38:47.323128 24578 raft_consensus.cc:2781] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:47.330714 24578 raft_consensus.cc:482] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:47.331200 24578 raft_consensus.cc:3037] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:47.321934 23675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57116 (request call id 357) took 1043 ms. Trace:
I20260807 13:38:47.331959 23675 rpcz_store.cc:276] 0807 13:38:46.347283 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:46.641690 (+294407us) service_pool.cc:227] Handling call
0807 13:38:47.204728 (+563038us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b5800004298. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:47.303943 (+ 99215us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b5800004298. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ffb7c 00007fc6950ff73b 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:47.320053 (+ 16110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":54197888}
I20260807 13:38:47.334650 23675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 333) took 1233 ms. Trace:
I20260807 13:38:47.335296 24434 leader_election.cc:288] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:47.337415 23674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 288) took 2178 ms. Trace:
I20260807 13:38:47.322422 24345 raft_consensus.cc:482] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
W20260807 13:38:47.389533 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 45533us
I20260807 13:38:47.363976 23681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 286) took 2247 ms. Trace:
I20260807 13:38:47.464051 23684 raft_consensus.cc:1261] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:47.364174 23479 raft_consensus.cc:1226] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 4 LEADER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4. Ops: []
I20260807 13:38:47.511111 23684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 290) took 2099 ms. Trace:
I20260807 13:38:47.437698 23737 tablet_bootstrap.cc:654] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:47.511978 23684 rpcz_store.cc:276] 0807 13:38:45.411331 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:47.339783 (+1928452us) service_pool.cc:227] Handling call
0807 13:38:47.374343 (+ 34560us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:47.510829 (+136486us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:47.511050 (+ 221us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:38:47.436374 23429 consensus_peers.cc:487] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 -> Peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Couldn't send request to peer 5e0ea5aa0c6d4846a5ccc9962342e17a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:38:47.510322 23681 rpcz_store.cc:276] 0807 13:38:45.093601 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:47.263027 (+2169426us) service_pool.cc:227] Handling call
0807 13:38:47.292251 (+ 29224us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:47.340395 (+ 48144us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:47.340440 (+ 45us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:47.340507 (+ 67us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:47.340556 (+ 49us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:47.340648 (+ 92us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:47.340832 (+ 184us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:38:47.513955 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 184968us
I20260807 13:38:47.424553 24450 leader_election.cc:288] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:47.433844 23676 raft_consensus.cc:1261] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:47.518654 23676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 282) took 2542 ms. Trace:
I20260807 13:38:47.520560 23676 rpcz_store.cc:276] 0807 13:38:44.976618 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:47.204106 (+2227488us) service_pool.cc:227] Handling call
0807 13:38:47.432916 (+228810us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b5800004298. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:38:47.433225 (+ 309us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:47.518322 (+ 85097us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:47.518585 (+ 263us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7468800}
W20260807 13:38:47.438984 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 166494us
W20260807 13:38:47.387385 24576 log.cc:924] Time spent T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.141s user 0.000s sys 0.001s
I20260807 13:38:47.521908 23684 raft_consensus.cc:1226] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:38:47.522290 23681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 350) took 1297 ms. Trace:
I20260807 13:38:47.389822 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:47.515748 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 177226us
I20260807 13:38:47.525995 23681 rpcz_store.cc:276] 0807 13:38:46.224092 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:47.513784 (+1289692us) service_pool.cc:227] Handling call
0807 13:38:47.520406 (+ 6622us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:47.520657 (+ 251us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:47.520684 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:47.520750 (+ 66us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:47.520778 (+ 28us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:47.520830 (+ 52us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:47.520952 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:47.526644 24356 consensus_queue.cc:1035] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260807 13:38:47.528446 23430 leader_election.cc:302] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:47.530601 24356 raft_consensus.cc:2726] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:47.530921 23681 raft_consensus.cc:1261] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:47.531589 23681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 300) took 1134 ms. Trace:
I20260807 13:38:47.514066 23679 raft_consensus.cc:2454] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:47.526199 23684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 358) took 1177 ms. Trace:
I20260807 13:38:47.531631 23739 tablet_bootstrap.cc:492] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:47.534729 23739 ts_tablet_manager.cc:1397] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.583s user 0.017s sys 0.022s
I20260807 13:38:47.464407 23672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 283) took 2462 ms. Trace:
I20260807 13:38:47.464658 24507 leader_election.cc:288] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:47.533764 23740 tablet_bootstrap.cc:492] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:47.536369 23740 ts_tablet_manager.cc:1397] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.924s user 0.017s sys 0.030s
I20260807 13:38:47.534015 23684 rpcz_store.cc:276] 0807 13:38:46.348625 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:47.521198 (+1172573us) service_pool.cc:227] Handling call
0807 13:38:47.521559 (+ 361us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:47.525898 (+ 4339us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:47.526121 (+ 223us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:47.533113 23681 rpcz_store.cc:276] 0807 13:38:46.397330 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:47.530124 (+1132794us) service_pool.cc:227] Handling call
0807 13:38:47.530536 (+ 412us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:47.531306 (+ 770us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:47.531532 (+ 226us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:47.540055 23581 raft_consensus.cc:3037] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:38:47.536334 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 250831us
I20260807 13:38:47.400761 24330 raft_consensus.cc:2726] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:47.533578 23430 leader_election.cc:302] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:47.429988 23680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 276) took 2847 ms. Trace:
I20260807 13:38:47.343353 24169 leader_election.cc:288] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:47.512501 24345 raft_consensus.cc:3037] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:47.428086 24434 raft_consensus.cc:482] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:47.546156 24485 consensus_queue.cc:1035] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260807 13:38:47.546846 23680 rpcz_store.cc:276] 0807 13:38:44.619259 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:46.964806 (+2345547us) service_pool.cc:227] Handling call
0807 13:38:46.965267 (+ 461us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:46.965787 (+ 520us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:46.965820 (+ 33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:46.966347 (+ 527us) log.cc:842] Serialized 26 byte log entry
0807 13:38:47.153942 (+187595us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:47.428760 (+274818us) spinlock_profiling.cc:243] Waited 6.15 ms on lock 0x7b18000fbda0. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc69dfd68b1 00007fc69dfe3661 00007fc697cee82c 00007fc6951199dc 00007fc69df50a39 00007fc6951368bb 00007fc695134cbf 00007fc695134155 00007fc69ba34167 00007fc698069807 00007fc698078f0f
0807 13:38:47.429003 (+ 243us) log.cc:842] Serialized 14 byte log entry
0807 13:38:47.429324 (+ 321us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:47.429433 (+ 109us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:47.429496 (+ 63us) raft_consensus.cc:1671] finished
0807 13:38:47.429650 (+ 154us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:47.429869 (+ 219us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":71097,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":5273,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":258,"spinlock_wait_cycles":14143744,"thread_start_us":238180,"threads_started":2,"wal-append.queue_time_us":222535}
I20260807 13:38:47.560720 23739 raft_consensus.cc:348] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.565958 23739 raft_consensus.cc:374] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:47.567023 23739 raft_consensus.cc:729] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:47.335091 23675 rpcz_store.cc:276] 0807 13:38:46.101092 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:47.333152 (+1232060us) service_pool.cc:227] Handling call
0807 13:38:47.333715 (+ 563us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:47.334170 (+ 455us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:47.334213 (+ 43us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:47.334281 (+ 68us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:47.334324 (+ 43us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:47.334408 (+ 84us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:47.334557 (+ 149us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1881,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":236}
I20260807 13:38:47.569316 24169 raft_consensus.cc:2781] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:47.569804 24169 raft_consensus.cc:482] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:47.569474 23430 leader_election.cc:302] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:47.570170 24169 raft_consensus.cc:3037] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:47.570705 24306 raft_consensus.cc:2726] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:38:47.570458 23739 consensus_queue.cc:260] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.567468 23633 leader_election.cc:302] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:47.575917 24330 raft_consensus.cc:2726] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:47.576705 23633 leader_election.cc:302] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:47.577380 24315 raft_consensus.cc:504] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.533684 23677 raft_consensus.cc:2454] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:47.580446 23677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57122 (request call id 302) took 1168 ms. Trace:
I20260807 13:38:47.580937 23677 rpcz_store.cc:276] 0807 13:38:46.411834 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:46.483472 (+ 71638us) service_pool.cc:227] Handling call
0807 13:38:47.205953 (+722481us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b5800004298. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:47.374235 (+168282us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b5800004298. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ffb7c 00007fc6950ff73b 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:47.580351 (+206116us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":34436864}
I20260807 13:38:47.586517 24330 raft_consensus.cc:2781] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:47.587441 24306 consensus_queue.cc:1035] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:47.588065 24330 raft_consensus.cc:482] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:47.588578 24330 raft_consensus.cc:3037] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:47.588832 24573 raft_consensus.cc:504] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.591266 24573 leader_election.cc:288] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:47.566277 23581 raft_consensus.cc:1261] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260807 13:38:47.597245 23581 pending_rounds.cc:76] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1: Aborting all ops after (but not including) 1
I20260807 13:38:47.600603 24434 raft_consensus.cc:504] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.578153 23633 leader_election.cc:302] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:47.593899 23739 ts_tablet_manager.cc:1428] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.059s user 0.006s sys 0.004s
I20260807 13:38:47.597541 23581 pending_rounds.cc:97] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260807 13:38:47.583592 24315 leader_election.cc:288] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:47.620131 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 74918.5us
I20260807 13:38:47.621307 23581 raft_consensus.cc:2866] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:38:47.337978 23674 rpcz_store.cc:276] 0807 13:38:45.158830 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:47.326587 (+2167757us) service_pool.cc:227] Handling call
0807 13:38:47.336516 (+ 9929us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:47.336914 (+ 398us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:47.336947 (+ 33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:47.337022 (+ 75us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:47.337058 (+ 36us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:47.337136 (+ 78us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:47.337311 (+ 175us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:47.622745 23581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 195) took 1034 ms. Trace:
I20260807 13:38:47.623204 23581 rpcz_store.cc:276] 0807 13:38:46.593964 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:47.145426 (+551462us) service_pool.cc:227] Handling call
0807 13:38:47.158582 (+ 13156us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:47.539119 (+380537us) spinlock_profiling.cc:243] Waited 65.1 ms on lock 0x7b540017d520. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc697fed40d 00007fc697fdb050 00007fc69803eaba 00007fc6980563af 00007fc698057b4e 00007fc698061c89 00007fc698062556 00007fc69805eedf 00007fc69805e99e 00007fc69cfa02e9
0807 13:38:47.622395 (+ 83276us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:47.622683 (+ 288us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":149811072}
I20260807 13:38:47.664141 23739 tablet_bootstrap.cc:492] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:47.663975 24578 raft_consensus.cc:504] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.535706 23672 rpcz_store.cc:276] 0807 13:38:44.976918 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:47.260995 (+2284077us) service_pool.cc:227] Handling call
0807 13:38:47.320756 (+ 59761us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:47.340937 (+ 20181us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:47.343090 (+ 2153us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:47.370519 (+ 27429us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:47.372839 (+ 2320us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:47.378511 (+ 5672us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:47.439165 (+ 60654us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:38:47.671557 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 67059.5us
W20260807 13:38:47.673784 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 53785.4us
W20260807 13:38:47.676324 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 98236.3us
W20260807 13:38:47.679306 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 55049.9us
I20260807 13:38:47.667308 24450 raft_consensus.cc:2781] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:47.682821 23633 leader_election.cc:302] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:47.681116 23533 leader_election.cc:302] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
W20260807 13:38:47.686061 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 162436us
I20260807 13:38:47.687139 23740 raft_consensus.cc:348] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.689481 23740 raft_consensus.cc:374] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:47.689740 23740 raft_consensus.cc:729] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:47.695197 23740 consensus_queue.cc:260] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.686208 24450 raft_consensus.cc:482] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:47.688126 24578 leader_election.cc:288] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:47.692423 24507 raft_consensus.cc:2781] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:47.722613 23429 leader_election.cc:302] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
W20260807 13:38:47.725507 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 44890.4us
I20260807 13:38:47.726641 23633 leader_election.cc:302] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:47.684899 24573 consensus_queue.cc:1035] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260807 13:38:47.724195 24450 raft_consensus.cc:3037] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:47.738289 23740 ts_tablet_manager.cc:1428] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.201s user 0.009s sys 0.000s
I20260807 13:38:47.745852 23739 tablet_bootstrap.cc:654] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:47.725338 24507 raft_consensus.cc:482] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:47.728056 24461 raft_consensus.cc:2726] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:38:47.692294 24306 consensus_queue.cc:1035] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260807 13:38:47.752815 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:47.754112 23575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 314) took 1880 ms. Trace:
I20260807 13:38:47.754304 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:47.757085 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 90072.7us
I20260807 13:38:47.758350 23479 raft_consensus.cc:2379] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:47.750190 24578 raft_consensus.cc:2781] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:47.769397 23671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 298) took 1901 ms. Trace:
I20260807 13:38:47.754894 24507 raft_consensus.cc:3037] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:47.776273 23481 raft_consensus.cc:2396] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:38:47.735200 24330 raft_consensus.cc:504] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.787865 23532 leader_election.cc:302] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:47.788698 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:47.789140 24508 raft_consensus.cc:2781] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:47.789430 23471 raft_consensus.cc:2362] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4. Re-sending same reply.
I20260807 13:38:47.789682 24508 raft_consensus.cc:482] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:47.790210 24508 raft_consensus.cc:3037] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:47.790128 24169 raft_consensus.cc:504] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.790894 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:47.787950 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:47.792403 24169 leader_election.cc:288] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:47.755352 23575 rpcz_store.cc:276] 0807 13:38:45.873794 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:46.961290 (+1087496us) service_pool.cc:227] Handling call
0807 13:38:47.156305 (+195015us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:47.164250 (+ 7945us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:47.164286 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:47.292717 (+128431us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b2c00000238. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc696a42e11 00007fc696a52442 00007fc69809ac11 00007fc69805f58a 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772
0807 13:38:47.336617 (+ 43900us) log.cc:842] Serialized 26 byte log entry
0807 13:38:47.422951 (+ 86334us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:38:47.423024 (+ 73us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:47.424023 (+ 999us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:47.752267 (+328244us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b44000706f0. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc69501121c 00007fc695011677 00007fc697d0e125 00007fc697d0e859 00007fc697d0ea5a 00007fc697d0ec2d 00007fc697ce66e8 00007fc697ce1aea 00007fc697ce0f36 00007fc697ce0b58
0807 13:38:47.753789 (+ 1522us) raft_consensus.cc:1671] finished
0807 13:38:47.753826 (+ 37us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:47.754011 (+ 185us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":482,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":165,"spinlock_wait_cycles":48247296,"thread_start_us":76374,"threads_started":1,"wal-append.queue_time_us":179155}
I20260807 13:38:47.770058 23671 rpcz_store.cc:276] 0807 13:38:45.868011 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:47.373820 (+1505809us) service_pool.cc:227] Handling call
0807 13:38:47.583693 (+209873us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:47.584444 (+ 751us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:47.584492 (+ 48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:47.585086 (+ 594us) log.cc:842] Serialized 26 byte log entry
0807 13:38:47.663593 (+ 78507us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:47.663702 (+ 109us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:47.663786 (+ 84us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:47.746182 (+ 82396us) spinlock_profiling.cc:243] Waited 916 us on lock 0x7b44000232cc. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc695049a95 00007fc69504a4b2 00007fc697cf2511 00007fc697cede1a 00007fc697ce1bee 00007fc697ce0f36 00007fc697ce0b58 00007fc697cea551 00007fc697cea509 00007fc697cea499
0807 13:38:47.749336 (+ 3154us) raft_consensus.cc:1671] finished
0807 13:38:47.750809 (+ 1473us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:47.769315 (+ 18506us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":142,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":112,"spinlock_wait_cycles":2106624,"thread_start_us":39306,"threads_started":1,"wal-append.queue_time_us":92444}
W20260807 13:38:47.793424 24598 log.cc:924] Time spent T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.067s user 0.000s sys 0.001s
I20260807 13:38:47.793601 23533 leader_election.cc:302] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:47.798518 24417 raft_consensus.cc:2726] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:47.762427 24519 consensus_queue.cc:1035] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260807 13:38:47.800112 24434 leader_election.cc:288] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:47.801000 24434 raft_consensus.cc:2781] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:47.763221 24279 consensus_queue.cc:1035] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260807 13:38:47.801477 24434 raft_consensus.cc:482] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:47.801918 24434 raft_consensus.cc:3037] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:47.801263 23533 leader_election.cc:302] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:47.803505 24519 raft_consensus.cc:2726] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:47.805260 23533 leader_election.cc:302] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:47.806313 23740 tablet_bootstrap.cc:492] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:47.789466 24330 leader_election.cc:288] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:47.817936 23574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 196) took 1129 ms. Trace:
I20260807 13:38:47.824476 24345 raft_consensus.cc:504] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.770829 24578 raft_consensus.cc:482] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
W20260807 13:38:47.826287 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 99767.7us
I20260807 13:38:47.829628 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:47.845718 23633 leader_election.cc:302] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:47.846342 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:47.828332 23574 rpcz_store.cc:276] 0807 13:38:46.688848 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:47.188155 (+499307us) service_pool.cc:227] Handling call
0807 13:38:47.233148 (+ 44993us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:47.320359 (+ 87211us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:47.323513 (+ 3154us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:47.388469 (+ 64956us) log.cc:842] Serialized 26 byte log entry
0807 13:38:47.624874 (+236405us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:47.673488 (+ 48614us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:47.680615 (+ 7127us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:47.812206 (+131591us) raft_consensus.cc:1671] finished
0807 13:38:47.817631 (+ 5425us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:47.817856 (+ 225us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14947,"raft.queue_time_us":26993,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":215351,"threads_started":1,"wal-append.queue_time_us":296013}
I20260807 13:38:47.853758 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:47.854857 23478 raft_consensus.cc:2454] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:47.855880 24330 raft_consensus.cc:2781] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:47.856438 24330 raft_consensus.cc:482] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:47.856861 24330 raft_consensus.cc:3037] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:47.857522 24507 raft_consensus.cc:504] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.831919 24437 raft_consensus.cc:2726] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:47.847288 23633 leader_election.cc:302] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:47.861626 24607 raft_consensus.cc:2781] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:47.862166 24607 raft_consensus.cc:482] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:47.862673 24607 raft_consensus.cc:3037] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:47.829941 24578 raft_consensus.cc:3037] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:47.872535 23532 leader_election.cc:302] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:47.872941 24450 raft_consensus.cc:504] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.874358 24315 raft_consensus.cc:2781] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:47.879424 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:47.879797 24315 raft_consensus.cc:482] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:47.882030 23479 raft_consensus.cc:2379] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:47.882181 24315 raft_consensus.cc:3037] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:47.879676 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:47.883955 23479 raft_consensus.cc:1261] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260807 13:38:47.876957 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:47.881570 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:47.881412 24450 leader_election.cc:288] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:47.886514 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:47.875123 23532 leader_election.cc:341] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:47.890148 24330 raft_consensus.cc:504] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.891736 24450 raft_consensus.cc:482] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:47.891839 23633 leader_election.cc:302] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:47.892541 24450 raft_consensus.cc:504] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.893110 24461 raft_consensus.cc:2781] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:47.893572 24461 raft_consensus.cc:482] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:47.893962 24461 raft_consensus.cc:3037] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:47.894114 23633 leader_election.cc:302] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:47.894999 24450 leader_election.cc:288] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:47.895380 23633 leader_election.cc:302] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
W20260807 13:38:47.901290 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 56134.8us
I20260807 13:38:47.879482 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:47.911150 23533 leader_election.cc:302] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:47.912463 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:47.912801 23633 leader_election.cc:302] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:47.913666 24595 raft_consensus.cc:2781] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:47.915519 24595 raft_consensus.cc:482] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:47.916018 24595 raft_consensus.cc:3037] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:47.917228 24330 leader_election.cc:288] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:47.895592 24450 raft_consensus.cc:2781] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:47.920506 24450 raft_consensus.cc:482] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:47.914253 24614 raft_consensus.cc:2781] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:47.921912 24330 raft_consensus.cc:2781] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:47.921339 24345 leader_election.cc:288] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:47.920924 24461 raft_consensus.cc:504] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.914824 23533 leader_election.cc:302] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:47.921398 23633 leader_election.cc:302] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:47.922174 24614 raft_consensus.cc:482] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:47.936771 24612 raft_consensus.cc:2726] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:38:47.938548 24614 raft_consensus.cc:3037] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:47.904079 24315 raft_consensus.cc:504] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.941421 24315 leader_election.cc:288] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:47.944082 24345 raft_consensus.cc:482] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:47.943871 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:47.920951 24450 raft_consensus.cc:3037] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:47.947178 23633 leader_election.cc:302] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
W20260807 13:38:48.005084 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 90382.9us
I20260807 13:38:47.992890 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:48.006151 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:48.013700 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9fcdd060ef64874a8719c95b2325942" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:48.014103 23478 raft_consensus.cc:2354] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3.
I20260807 13:38:48.014765 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:48.015178 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:48.016088 23471 raft_consensus.cc:2379] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 4: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:48.000226 24508 raft_consensus.cc:504] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.017032 23475 raft_consensus.cc:1261] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260807 13:38:48.017423 23475 pending_rounds.cc:76] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613: Aborting all ops after (but not including) 1
I20260807 13:38:48.017638 23475 pending_rounds.cc:97] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 13:38:48.017899 23475 raft_consensus.cc:2866] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:38:48.019565 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:48.022148 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:48.023234 23481 raft_consensus.cc:2379] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:48.023897 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:48.024151 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:48.024384 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:48.009040 23739 tablet_bootstrap.cc:492] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:48.008023 24345 raft_consensus.cc:504] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.012678 24612 raft_consensus.cc:2781] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:48.024123 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:48.026050 23739 ts_tablet_manager.cc:1397] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.362s user 0.039s sys 0.042s
I20260807 13:38:48.009963 23737 tablet_bootstrap.cc:492] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
W20260807 13:38:48.012077 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 64984.3us
I20260807 13:38:47.945992 24461 leader_election.cc:288] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
W20260807 13:38:48.103365 23633 leader_election.cc:341] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:48.104444 24461 consensus_queue.cc:1035] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:48.041208 24595 raft_consensus.cc:504] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.010665 24507 leader_election.cc:288] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:48.106102 24434 raft_consensus.cc:504] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:47.964365 24330 raft_consensus.cc:686] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:48.083346 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:48.102998 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:48.070921 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 44421us
W20260807 13:38:48.081316 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 131361us
I20260807 13:38:48.084409 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:48.107568 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:48.109005 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:48.123122 23737 ts_tablet_manager.cc:1397] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.931s user 0.042s sys 0.055s
I20260807 13:38:48.111034 24612 raft_consensus.cc:482] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:48.027091 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:48.040086 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:48.086186 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:48.043797 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:48.129712 24595 leader_election.cc:288] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:48.137384 23532 leader_election.cc:302] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
W20260807 13:38:48.135628 23533 leader_election.cc:341] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:48.142637 23684 raft_consensus.cc:2454] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:48.142640 23533 leader_election.cc:302] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:48.097659 23677 raft_consensus.cc:1226] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:48.073310 24315 raft_consensus.cc:2781] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:48.153918 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:48.122470 24279 raft_consensus.cc:482] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:48.046937 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:48.039942 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
W20260807 13:38:48.159264 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 54824.2us
I20260807 13:38:48.165321 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:48.138835 24612 raft_consensus.cc:3037] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:48.173687 23532 leader_election.cc:302] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:48.173703 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:48.157261 24315 raft_consensus.cc:482] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:48.131323 24607 raft_consensus.cc:504] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.188589 23580 raft_consensus.cc:2454] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
W20260807 13:38:48.195674 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 82611.5us
I20260807 13:38:48.196293 23684 raft_consensus.cc:1226] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:38:48.173365 24437 raft_consensus.cc:2781] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:48.189616 24519 raft_consensus.cc:2781] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:48.204371 23631 leader_election.cc:302] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:48.204651 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:48.205245 23581 raft_consensus.cc:3037] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:48.206847 24434 leader_election.cc:288] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:48.208321 24434 consensus_queue.cc:1035] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:38:48.197605 24315 raft_consensus.cc:3037] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:48.211795 24320 raft_consensus.cc:482] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:48.211952 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:48.212363 24320 raft_consensus.cc:504] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.214607 24320 leader_election.cc:288] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:48.216751 24345 leader_election.cc:288] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:48.204828 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:48.216784 24614 raft_consensus.cc:504] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.217943 23575 raft_consensus.cc:1261] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:48.218005 24593 consensus_queue.cc:1046] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:48.219363 24593 raft_consensus.cc:3032] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:38:48.219998 23679 raft_consensus.cc:1226] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:38:48.183737 24595 raft_consensus.cc:2726] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 13:38:48.220631 23533 leader_election.cc:341] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:48.212752 23571 raft_consensus.cc:2454] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:48.221097 23533 leader_election.cc:302] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:48.222433 23633 leader_election.cc:302] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:48.164645 24279 raft_consensus.cc:504] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.227553 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:48.225800 23739 raft_consensus.cc:348] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.230978 23739 raft_consensus.cc:374] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:48.231259 23739 raft_consensus.cc:729] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:48.203173 24437 raft_consensus.cc:482] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:48.234566 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:48.237363 23581 raft_consensus.cc:2454] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4.
I20260807 13:38:48.239717 23684 raft_consensus.cc:3037] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:48.238584 23739 consensus_queue.cc:260] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.205415 24508 leader_election.cc:288] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:48.233793 23532 leader_election.cc:302] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:48.220219 24519 raft_consensus.cc:482] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:48.225646 24593 raft_consensus.cc:729] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:48.249791 23739 ts_tablet_manager.cc:1428] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.127s user 0.006s sys 0.000s
I20260807 13:38:48.250974 23739 tablet_bootstrap.cc:492] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:48.250509 24593 consensus_queue.cc:260] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.245846 24633 raft_consensus.cc:2726] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:48.251927 24593 raft_consensus.cc:3037] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:48.252403 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:48.253757 24461 raft_consensus.cc:2781] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:48.254150 24461 raft_consensus.cc:482] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:48.254523 24461 raft_consensus.cc:3037] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:48.254454 24279 leader_election.cc:288] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:48.255561 23533 leader_election.cc:302] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:48.245855 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:48.190318 24330 consensus_queue.cc:237] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.246344 23633 leader_election.cc:302] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:48.246119 24519 raft_consensus.cc:3037] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:48.261324 23633 leader_election.cc:302] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:48.244308 24595 raft_consensus.cc:2726] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:38:48.263432 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:48.265936 23740 tablet_bootstrap.cc:654] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:48.265645 24450 raft_consensus.cc:504] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.244551 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:48.267285 23681 raft_consensus.cc:1226] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:38:48.268909 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
W20260807 13:38:48.268263 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 65122.4us
I20260807 13:38:48.269826 23580 raft_consensus.cc:3037] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:48.277019 23429 leader_election.cc:302] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:48.278342 24573 raft_consensus.cc:2781] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:48.278760 24573 raft_consensus.cc:482] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:48.278862 24345 consensus_queue.cc:1046] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:38:48.249823 24607 leader_election.cc:288] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:48.279603 24306 consensus_queue.cc:1046] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:48.278198 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:48.279188 24573 raft_consensus.cc:3037] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:48.233332 23675 raft_consensus.cc:2454] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:48.234082 24614 leader_election.cc:288] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:48.242404 24437 raft_consensus.cc:3037] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:48.259192 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:48.288954 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:48.280961 23737 raft_consensus.cc:348] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.293601 23737 raft_consensus.cc:374] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:48.294027 23737 raft_consensus.cc:729] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:48.270704 24507 raft_consensus.cc:2741] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260807 13:38:48.275812 24279 raft_consensus.cc:482] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:48.305119 24279 raft_consensus.cc:504] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.305773 23737 consensus_queue.cc:260] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.309405 24279 leader_election.cc:288] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:48.310381 23739 tablet_bootstrap.cc:654] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:48.310786 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:48.310840 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 106550us
W20260807 13:38:48.314776 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 59366.1us
I20260807 13:38:48.238937 24578 raft_consensus.cc:504] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.317083 23631 leader_election.cc:302] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:48.287918 24356 consensus_queue.cc:1046] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260807 13:38:48.319468 23577 raft_consensus.cc:2354] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 3. Current term is 4.
I20260807 13:38:48.285949 24508 raft_consensus.cc:2726] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:48.281730 24633 consensus_queue.cc:1035] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260807 13:38:48.324600 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:48.324330 24612 raft_consensus.cc:504] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.324332 23532 leader_election.cc:302] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:48.292359 24607 raft_consensus.cc:2781] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:38:48.346807 23533 leader_election.cc:302] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:48.327109 23737 ts_tablet_manager.cc:1428] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.193s user 0.004s sys 0.005s
I20260807 13:38:48.325977 23574 raft_consensus.cc:2379] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 2: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:48.323450 23675 raft_consensus.cc:1226] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:48.326102 24614 raft_consensus.cc:2781] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260807 13:38:48.390551 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 43873.6us
W20260807 13:38:48.393566 23407 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260807 13:38:48.399953 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 82949.6us
I20260807 13:38:48.401058 23631 leader_election.cc:302] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:48.377904 24507 raft_consensus.cc:2781] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:48.407344 23633 leader_election.cc:398] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Vote denied by peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363) with higher term. Message: Invalid argument: T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 3. Current term is 4.
I20260807 13:38:48.407841 23633 leader_election.cc:401] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260807 13:38:48.404153 23737 tablet_bootstrap.cc:492] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
W20260807 13:38:48.419474 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 118505us
I20260807 13:38:48.421762 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9fcdd060ef64874a8719c95b2325942" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:48.422197 24330 raft_consensus.cc:482] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:48.422506 23675 raft_consensus.cc:2454] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:38:48.422807 24330 raft_consensus.cc:504] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.425264 24330 leader_election.cc:288] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:48.425873 24330 raft_consensus.cc:482] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:48.426409 24330 raft_consensus.cc:504] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.383469 24508 raft_consensus.cc:2781] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:48.381476 24614 raft_consensus.cc:482] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:48.443878 24614 raft_consensus.cc:3037] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:48.384865 23677 raft_consensus.cc:3037] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:48.406759 24507 raft_consensus.cc:482] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:48.383989 24356 consensus_queue.cc:1046] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260807 13:38:48.442656 24634 raft_consensus.cc:2726] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:48.445204 24169 raft_consensus.cc:3032] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:38:48.609150 23739 tablet_bootstrap.cc:492] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:48.609354 24169 raft_consensus.cc:729] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:48.610078 24356 raft_consensus.cc:3032] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:38:48.576838 24306 raft_consensus.cc:482] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:48.610981 24306 raft_consensus.cc:504] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.610772 24169 consensus_queue.cc:260] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.612576 24169 raft_consensus.cc:3037] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:48.613348 24306 leader_election.cc:288] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:48.508783 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 156113us
I20260807 13:38:48.614923 23532 leader_election.cc:302] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:48.615809 24593 raft_consensus.cc:2781] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:38:48.616482 24593 raft_consensus.cc:686] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 4 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:48.617501 24593 consensus_queue.cc:237] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.448415 24578 leader_election.cc:288] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:48.446877 24450 leader_election.cc:288] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:48.620935 24507 raft_consensus.cc:3037] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:48.605358 24330 leader_election.cc:288] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:48.450589 23580 raft_consensus.cc:2454] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4.
I20260807 13:38:48.445767 24461 raft_consensus.cc:504] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.406445 23676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 367) took 1262 ms. Trace:
I20260807 13:38:48.627540 24612 leader_election.cc:288] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:48.429415 24636 raft_consensus.cc:2726] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:48.432108 24508 raft_consensus.cc:482] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:48.447201 24315 raft_consensus.cc:504] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.610109 23739 ts_tablet_manager.cc:1397] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.359s user 0.033s sys 0.027s
W20260807 13:38:48.604676 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 203735us
I20260807 13:38:48.505884 24649 raft_consensus.cc:3037] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:48.630494 23631 leader_election.cc:398] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Vote denied by peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037) with higher term. Message: Invalid argument: T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3.
I20260807 13:38:48.630741 24315 leader_election.cc:288] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:48.448872 23533 leader_election.cc:398] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Vote denied by peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765) with higher term. Message: Invalid argument: T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 2. Current term is 3.
W20260807 13:38:48.456542 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 71762.7us
I20260807 13:38:48.627948 23676 rpcz_store.cc:276] 0807 13:38:47.140263 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:47.547763 (+407500us) service_pool.cc:227] Handling call
0807 13:38:47.678638 (+130875us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:47.905561 (+226923us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:47.922730 (+ 17169us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:47.929420 (+ 6690us) log.cc:842] Serialized 26 byte log entry
0807 13:38:48.102864 (+173444us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:48.192048 (+ 89184us) log.cc:842] Serialized 14 byte log entry
0807 13:38:48.374165 (+182117us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:48.381351 (+ 7186us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:48.383831 (+ 2480us) raft_consensus.cc:1671] finished
0807 13:38:48.384591 (+ 760us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:48.402967 (+ 18376us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":27803,"prepare.queue_time_us":25204,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":153630,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":5412,"thread_start_us":542290,"threads_started":4,"wal-append.queue_time_us":259965}
I20260807 13:38:48.640224 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:48.640941 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:48.627543 24461 leader_election.cc:288] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:48.642611 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:48.589272 24621 raft_consensus.cc:482] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
W20260807 13:38:48.631307 23631 leader_election.cc:341] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:48.649798 23631 leader_election.cc:302] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:48.651160 23631 leader_election.cc:302] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:48.652959 23631 leader_election.cc:302] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:48.653923 24279 raft_consensus.cc:3032] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:48.654309 24279 raft_consensus.cc:729] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:48.654492 23631 leader_election.cc:302] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:48.655098 23684 raft_consensus.cc:2454] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:48.631348 24508 raft_consensus.cc:3037] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:48.656489 24434 raft_consensus.cc:2726] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:48.657183 24434 raft_consensus.cc:3037] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:48.631978 23739 raft_consensus.cc:348] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.518193 24345 raft_consensus.cc:482] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:48.659437 23739 raft_consensus.cc:374] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:48.666147 23739 raft_consensus.cc:729] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:48.628371 24507 raft_consensus.cc:504] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.677753 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:48.679472 23580 raft_consensus.cc:2379] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 1: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:48.650471 24356 raft_consensus.cc:729] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:48.682106 24356 consensus_queue.cc:260] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:48.685065 23631 leader_election.cc:341] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:48.684055 23739 consensus_queue.cc:260] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.689029 23740 tablet_bootstrap.cc:492] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:48.689576 23740 ts_tablet_manager.cc:1397] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.923s user 0.017s sys 0.010s
W20260807 13:38:48.690254 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 241544us
I20260807 13:38:48.683377 24356 raft_consensus.cc:3037] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:48.705407 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:48.689919 23633 leader_election.cc:302] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:48.707372 23631 leader_election.cc:302] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:48.660044 24461 raft_consensus.cc:2726] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:48.712301 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:48.689587 24612 raft_consensus.cc:2726] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:38:48.715528 23580 raft_consensus.cc:3037] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:48.713685 23631 leader_election.cc:302] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:48.718382 23739 ts_tablet_manager.cc:1428] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.089s user 0.007s sys 0.000s
I20260807 13:38:48.719336 23631 leader_election.cc:302] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:48.649791 24621 raft_consensus.cc:504] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:38:48.718570 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:48.722512 23533 leader_election.cc:302] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:48.719189 24593 consensus_queue.cc:1035] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260807 13:38:48.712381 24315 raft_consensus.cc:482] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:48.712018 24636 raft_consensus.cc:2781] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:38:48.727186 24507 leader_election.cc:288] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:48.712289 24450 raft_consensus.cc:2726] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:38:48.728529 24653 raft_consensus.cc:482] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:48.734683 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:48.729043 24661 raft_consensus.cc:2726] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:48.731244 23631 leader_election.cc:302] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:48.735500 23737 tablet_bootstrap.cc:654] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
W20260807 13:38:48.735731 23533 leader_election.cc:341] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:48.730337 24437 raft_consensus.cc:504] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.712652 24649 raft_consensus.cc:2726] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363) with higher term. Message: Invalid argument: T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 3. Current term is 4.
I20260807 13:38:48.703955 24345 raft_consensus.cc:504] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.738974 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9fcdd060ef64874a8719c95b2325942" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:48.737231 23533 leader_election.cc:302] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:48.739720 23480 raft_consensus.cc:2454] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:48.740262 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:48.740705 23479 raft_consensus.cc:3037] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:48.655109 24279 consensus_queue.cc:260] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.743724 23572 raft_consensus.cc:2454] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:48.731479 24461 raft_consensus.cc:2726] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:38:48.744138 23473 raft_consensus.cc:1226] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4. Ops: []
I20260807 13:38:48.744714 24485 raft_consensus.cc:3032] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:38:48.745136 24636 raft_consensus.cc:686] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:48.736596 24315 raft_consensus.cc:504] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.774011 24508 raft_consensus.cc:504] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.775429 24315 leader_election.cc:288] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:48.745751 24450 raft_consensus.cc:2726] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:48.737618 24320 raft_consensus.cc:2781] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:48.776283 24320 raft_consensus.cc:482] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:48.776353 23577 raft_consensus.cc:2379] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 4: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:48.776736 24320 raft_consensus.cc:3037] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:48.778606 24508 leader_election.cc:288] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:48.737752 24653 raft_consensus.cc:504] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.759852 23580 raft_consensus.cc:2454] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:48.768018 24279 raft_consensus.cc:3037] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:38:48.769428 24519 consensus_meta.cc:287] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.508s user 0.003s sys 0.016s
I20260807 13:38:48.769940 23677 raft_consensus.cc:2454] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:48.784518 23633 leader_election.cc:302] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:48.733306 24607 raft_consensus.cc:686] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
W20260807 13:38:48.785823 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 62645.2us
I20260807 13:38:48.786877 23631 leader_election.cc:302] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:48.771883 23533 leader_election.cc:302] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:48.772049 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:48.711745 24652 consensus_queue.cc:1035] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260807 13:38:48.792518 23532 leader_election.cc:302] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:48.792533 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:48.794186 23481 raft_consensus.cc:3037] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:48.800247 23479 raft_consensus.cc:2454] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
I20260807 13:38:48.760548 24485 raft_consensus.cc:729] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:48.785017 24595 raft_consensus.cc:2726] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:48.804862 23633 leader_election.cc:302] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:48.808193 24649 raft_consensus.cc:482] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:48.798708 24593 raft_consensus.cc:2781] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:48.810575 23479 raft_consensus.cc:1226] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 2. Current term is 3. Ops: []
I20260807 13:38:48.805330 24508 raft_consensus.cc:2741] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260807 13:38:48.792908 24661 raft_consensus.cc:2726] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:38:48.813235 24639 raft_consensus.cc:482] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:48.809211 24330 raft_consensus.cc:2741] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260807 13:38:48.813824 24639 raft_consensus.cc:504] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.816493 24639 leader_election.cc:288] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
W20260807 13:38:48.811811 23533 leader_election.cc:341] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:48.817874 23533 leader_election.cc:302] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:48.818159 23740 raft_consensus.cc:348] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.818904 23740 raft_consensus.cc:374] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260807 13:38:48.819124 23533 leader_election.cc:341] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:48.820366 24653 leader_election.cc:288] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:48.821059 24647 raft_consensus.cc:2781] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:38:48.821647 24647 raft_consensus.cc:686] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:48.821846 24636 consensus_queue.cc:237] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.822860 24437 leader_election.cc:288] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:48.822649 24647 consensus_queue.cc:237] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.823515 24437 raft_consensus.cc:2726] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:38:48.809051 24315 consensus_queue.cc:1046] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260807 13:38:48.796708 24519 raft_consensus.cc:504] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.824443 24621 leader_election.cc:288] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037)
I20260807 13:38:48.825008 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:48.825716 23575 raft_consensus.cc:2454] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:48.825927 24519 leader_election.cc:288] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:48.826264 24345 leader_election.cc:288] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:48.824462 24315 raft_consensus.cc:3032] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:38:48.826812 24315 raft_consensus.cc:729] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:48.826928 23470 raft_consensus.cc:1226] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:48.827602 24315 consensus_queue.cc:260] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.828497 24649 raft_consensus.cc:504] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.821470 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:48.829643 23475 raft_consensus.cc:3037] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:48.830801 24649 leader_election.cc:288] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:48.832177 23533 leader_election.cc:302] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:48.819171 23740 raft_consensus.cc:729] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:48.828578 24614 raft_consensus.cc:504] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.828987 24315 raft_consensus.cc:3037] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:48.844386 24614 leader_election.cc:288] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:48.845932 24434 raft_consensus.cc:2726] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:38:48.846865 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "356c6b3e51454d418acaa9be70bb9689" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:48.847613 23469 raft_consensus.cc:3037] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:48.833465 23740 consensus_queue.cc:260] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.849794 23740 ts_tablet_manager.cc:1428] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.146s user 0.001s sys 0.005s
I20260807 13:38:48.811811 24593 raft_consensus.cc:482] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:48.838979 23533 leader_election.cc:302] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:48.840206 24595 raft_consensus.cc:2781] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:48.842250 23478 raft_consensus.cc:1226] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:48.864602 24595 raft_consensus.cc:482] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:48.865033 24595 raft_consensus.cc:3037] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:48.850099 23633 leader_election.cc:302] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:48.852064 23580 raft_consensus.cc:1261] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:48.867434 24614 raft_consensus.cc:2781] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:48.867808 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:48.868019 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:48.868518 23572 raft_consensus.cc:3037] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:48.858191 23740 tablet_bootstrap.cc:492] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:48.868721 23575 raft_consensus.cc:2454] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
W20260807 13:38:48.837518 24573 consensus_meta.cc:287] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.545s user 0.013s sys 0.004s
I20260807 13:38:48.858742 23342 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41390 (request call id 70) took 6403 ms. Trace:
I20260807 13:38:48.867852 24614 raft_consensus.cc:482] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:48.872318 24614 raft_consensus.cc:3037] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:48.871829 23342 rpcz_store.cc:276] 0807 13:38:42.455958 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:42.456228 (+ 270us) service_pool.cc:227] Handling call
0807 13:38:48.858669 (+6402441us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:38:47.023187 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:38:47.031058 (+ 7871us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:38:47.031337 (+ 279us) write_op.cc:435] Acquired schema lock
0807 13:38:47.031363 (+ 26us) tablet.cc:660] Decoding operations
0807 13:38:47.036368 (+ 5005us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:38:47.039006 (+ 2638us) write_op.cc:641] Partition lock acquired for write op
0807 13:38:47.039109 (+ 103us) tablet.cc:683] Acquiring locks for 4 operations
0807 13:38:47.154483 (+115374us) tablet.cc:699] Row locks acquired
0807 13:38:47.160112 (+ 5629us) write_op.cc:260] PREPARE: finished
0807 13:38:47.185943 (+ 25831us) write_op.cc:270] Start()
0807 13:38:47.196071 (+ 10128us) write_op.cc:276] Timestamp: P: 1786109927175063 usec, L: 0
0807 13:38:47.196123 (+ 52us) op_driver.cc:331] REPLICATION: starting
0807 13:38:47.198672 (+ 2549us) log.cc:842] Serialized 1681 byte log entry
0807 13:38:47.622047 (+423375us) op_driver.cc:444] REPLICATION: finished
0807 13:38:47.837599 (+215552us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b44000232cc. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc695049a95 00007fc69504a4b2 00007fc697cf2511 00007fc697cede1a 00007fc6951195fe 00007fc69df50a39 00007fc6951368bb 00007fc695134cbf 00007fc695136e22 00007fc69ba6f410
0807 13:38:48.002990 (+165391us) write_op.cc:301] APPLY: starting
0807 13:38:48.003092 (+ 102us) tablet.cc:1365] starting BulkCheckPresence
0807 13:38:48.003315 (+ 223us) tablet.cc:1368] finished BulkCheckPresence
0807 13:38:48.003370 (+ 55us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:38:48.004498 (+ 1128us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:38:48.004803 (+ 305us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0807 13:38:48.004881 (+ 78us) write_op.cc:312] APPLY: finished
0807 13:38:48.127870 (+122989us) log.cc:842] Serialized 40 byte log entry
0807 13:38:48.128121 (+ 251us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:38:48.128228 (+ 107us) write_op.cc:454] Released schema lock
0807 13:38:48.128299 (+ 71us) write_op.cc:341] FINISH: Updating metrics
0807 13:38:48.128676 (+ 377us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:38:48.128723 (+ 47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":188,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":380605,"apply.run_cpu_time_us":4129,"apply.run_wall_time_us":126135,"num_ops":4,"prepare.queue_time_us":146057,"prepare.run_cpu_time_us":20882,"prepare.run_wall_time_us":302262,"raft.queue_time_us":81333,"raft.run_cpu_time_us":36906,"raft.run_wall_time_us":369439,"replication_time_us":425822,"spinlock_wait_cycles":4615040,"thread_start_us":627038,"threads_started":4,"wal-append.queue_time_us":178760}]]}
I20260807 13:38:48.874678 24320 raft_consensus.cc:504] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.859732 24519 raft_consensus.cc:2781] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:48.875844 24519 raft_consensus.cc:482] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:48.876276 24519 raft_consensus.cc:3037] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:48.830979 24485 consensus_queue.cc:260] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.877033 23633 leader_election.cc:302] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:48.877250 24485 raft_consensus.cc:3037] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:48.878227 24661 consensus_queue.cc:1035] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:38:48.860936 24593 raft_consensus.cc:3037] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:48.879465 24657 raft_consensus.cc:2781] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:48.879908 24657 raft_consensus.cc:482] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:48.880332 24657 raft_consensus.cc:3037] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:48.861635 23739 tablet_bootstrap.cc:492] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:48.883968 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:48.884752 23481 raft_consensus.cc:2454] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:48.871528 24573 raft_consensus.cc:504] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.859113 23344 catalog_manager.cc:5495] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 0 to 1, leader changed from <none> to e11cad1eeaf5424c94e51241096f6613 (127.21.69.1). New cstate: current_term: 1 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
W20260807 13:38:48.905305 23429 leader_election.cc:341] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:48.906414 23429 leader_election.cc:302] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
W20260807 13:38:48.907189 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 134240us
I20260807 13:38:48.912325 23532 leader_election.cc:302] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
W20260807 13:38:48.915792 23429 consensus_peers.cc:487] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 -> Peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Couldn't send request to peer 5e0ea5aa0c6d4846a5ccc9962342e17a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:38:48.917634 24573 leader_election.cc:288] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:48.914098 23344 catalog_manager.cc:5495] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 1 to 2, leader changed from 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3) to e11cad1eeaf5424c94e51241096f6613 (127.21.69.1). New cstate: current_term: 2 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:48.921206 24320 leader_election.cc:288] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:48.925071 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 67556.9us
I20260807 13:38:48.924146 23429 leader_election.cc:302] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:48.936570 23572 raft_consensus.cc:2454] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:48.915145 24437 raft_consensus.cc:2781] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:38:48.937546 24653 consensus_queue.cc:1046] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:38:49.019119 24485 raft_consensus.cc:482] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:49.024585 24315 consensus_queue.cc:1046] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:38:49.014031 24593 raft_consensus.cc:504] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.942018 24437 raft_consensus.cc:686] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 4 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:49.026487 24315 raft_consensus.cc:3032] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:38:49.026886 24315 raft_consensus.cc:729] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:49.027295 24437 consensus_queue.cc:237] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.027992 24593 leader_election.cc:288] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:49.027750 24315 consensus_queue.cc:260] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.942885 24450 raft_consensus.cc:482] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:49.029093 24315 raft_consensus.cc:3037] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:49.029336 24450 raft_consensus.cc:504] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.030553 24650 consensus_queue.cc:1046] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:49.031836 24417 raft_consensus.cc:3032] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:49.032191 24417 raft_consensus.cc:729] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:49.032922 24485 raft_consensus.cc:504] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.033131 24417 consensus_queue.cc:260] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.034087 24450 leader_election.cc:288] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:49.034356 24417 raft_consensus.cc:3037] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:49.035006 24485 leader_election.cc:288] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:49.021517 24595 raft_consensus.cc:504] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.032141 23532 leader_election.cc:302] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:49.036773 24650 raft_consensus.cc:2781] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:49.037230 24650 raft_consensus.cc:686] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:49.037937 24595 leader_election.cc:288] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:49.038138 24650 consensus_queue.cc:237] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:48.946098 24653 raft_consensus.cc:3032] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:49.040369 24653 raft_consensus.cc:729] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:49.042179 23737 tablet_bootstrap.cc:492] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:49.042784 23737 ts_tablet_manager.cc:1397] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.654s user 0.014s sys 0.013s
I20260807 13:38:48.947270 24573 raft_consensus.cc:2781] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:49.043398 24573 raft_consensus.cc:482] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:49.045791 23737 raft_consensus.cc:348] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.046370 23429 leader_election.cc:302] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:49.046761 23737 raft_consensus.cc:374] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:49.047098 23737 raft_consensus.cc:729] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:49.047923 23737 consensus_queue.cc:260] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.020901 23740 tablet_bootstrap.cc:654] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:49.050143 23737 ts_tablet_manager.cc:1428] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.007s user 0.000s sys 0.008s
I20260807 13:38:49.051383 23737 tablet_bootstrap.cc:492] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:48.938740 23633 leader_election.cc:302] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:49.053037 24450 raft_consensus.cc:2781] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:38:49.053628 24450 raft_consensus.cc:686] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:49.022073 24657 raft_consensus.cc:504] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:38:49.054555 24450 consensus_queue.cc:237] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.056365 24657 leader_election.cc:288] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037)
I20260807 13:38:48.990401 23469 raft_consensus.cc:2454] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:48.991241 23475 raft_consensus.cc:2454] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:49.058147 24345 raft_consensus.cc:2741] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260807 13:38:49.043888 24573 raft_consensus.cc:3037] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:49.060556 24345 raft_consensus.cc:2781] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:49.061134 24345 raft_consensus.cc:686] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:49.023324 24614 raft_consensus.cc:504] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.062003 24345 consensus_queue.cc:237] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.063215 24614 leader_election.cc:288] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:49.063623 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:48.923321 24508 consensus_queue.cc:1046] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.141s
I20260807 13:38:48.919860 24607 consensus_queue.cc:237] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.065279 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4996c3c52ccc41b9a8da11ca747a8e6a" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:49.066092 23472 raft_consensus.cc:3037] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:49.028550 23739 tablet_bootstrap.cc:654] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
W20260807 13:38:49.068588 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 99964.6us
I20260807 13:38:49.069682 23533 leader_election.cc:302] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:49.074981 23429 leader_election.cc:302] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
W20260807 13:38:49.058135 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 119491us
I20260807 13:38:49.085955 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:49.086383 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:49.087239 23684 raft_consensus.cc:3037] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:49.087824 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9fcdd060ef64874a8719c95b2325942" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
W20260807 13:38:49.092954 23533 leader_election.cc:341] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:49.093609 23533 leader_election.cc:302] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:49.064785 24653 consensus_queue.cc:260] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.098471 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39707c5d97164544b9f5c03db41181c0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:49.095453 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:49.102262 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:49.102397 23679 raft_consensus.cc:1226] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:49.101613 24320 raft_consensus.cc:3032] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:49.019297 24519 raft_consensus.cc:504] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.112291 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:49.082535 24614 raft_consensus.cc:482] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:49.112354 23680 raft_consensus.cc:2454] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:49.117292 23475 raft_consensus.cc:2396] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:38:49.096297 24485 raft_consensus.cc:2781] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:49.110605 24320 raft_consensus.cc:729] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:49.127116 24320 consensus_queue.cc:260] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.128562 24320 raft_consensus.cc:3037] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:49.129033 24653 raft_consensus.cc:3037] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:49.132604 24573 raft_consensus.cc:504] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.102968 24595 raft_consensus.cc:2781] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:49.102602 24657 raft_consensus.cc:482] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:49.109318 24507 raft_consensus.cc:2726] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:49.146652 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:49.149080 23574 raft_consensus.cc:3037] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:49.128948 23472 raft_consensus.cc:2454] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:49.143054 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:49.122247 24614 raft_consensus.cc:504] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.166699 23574 raft_consensus.cc:2454] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4.
I20260807 13:38:49.150388 24657 raft_consensus.cc:504] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.168267 24614 leader_election.cc:288] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:49.144810 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:49.169126 23672 raft_consensus.cc:2454] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:49.147481 24595 raft_consensus.cc:482] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:49.165903 24645 raft_consensus.cc:482] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:49.171895 24595 raft_consensus.cc:3037] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:49.172631 23672 raft_consensus.cc:3037] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 2
I20260807 13:38:49.172083 24645 raft_consensus.cc:504] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.134334 23676 raft_consensus.cc:1226] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:38:49.159731 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:49.161329 23671 raft_consensus.cc:1226] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:49.161350 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:49.162061 23675 raft_consensus.cc:1226] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:38:49.162118 23681 raft_consensus.cc:1226] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 2. Current term is 3. Ops: []
I20260807 13:38:49.162566 23674 raft_consensus.cc:1226] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:49.163002 23677 raft_consensus.cc:1261] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:38:49.163475 24485 raft_consensus.cc:686] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:49.248324 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:49.249464 23470 raft_consensus.cc:2379] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 1: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:49.248771 24485 consensus_queue.cc:237] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.163570 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:49.165297 24519 leader_election.cc:288] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:49.109215 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:49.159621 23532 leader_election.cc:302] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:49.177469 24573 leader_election.cc:288] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:49.261057 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 101510us
I20260807 13:38:49.177747 23679 raft_consensus.cc:3037] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:49.177608 24657 leader_election.cc:288] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:49.211239 23740 tablet_bootstrap.cc:492] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:49.185498 23684 raft_consensus.cc:2454] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:49.272060 23740 ts_tablet_manager.cc:1397] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.414s user 0.018s sys 0.012s
I20260807 13:38:49.272183 23532 leader_election.cc:302] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:49.272475 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:49.273166 23684 raft_consensus.cc:2454] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:49.178615 23680 raft_consensus.cc:1226] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:49.211138 23481 raft_consensus.cc:2379] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 1: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:49.210453 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:49.202214 23633 leader_election.cc:302] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:49.183950 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:49.252748 23631 leader_election.cc:302] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
W20260807 13:38:49.253199 23429 leader_election.cc:341] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:49.178205 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:49.267830 24315 raft_consensus.cc:2781] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:49.276857 23480 raft_consensus.cc:2396] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:38:49.276708 23429 leader_election.cc:302] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:49.251179 24636 raft_consensus.cc:482] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:49.270807 23572 raft_consensus.cc:2396] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:38:49.176996 24645 leader_election.cc:288] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:49.270917 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9fcdd060ef64874a8719c95b2325942" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:49.282163 24345 raft_consensus.cc:2781] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:49.259088 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:49.283205 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:49.284263 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:49.286342 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 84280.7us
I20260807 13:38:49.319545 23479 raft_consensus.cc:2454] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:49.256525 24578 consensus_queue.cc:1046] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260807 13:38:49.290150 24593 raft_consensus.cc:482] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:49.294246 23532 leader_election.cc:302] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:49.257664 23575 raft_consensus.cc:3037] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:49.304873 23737 tablet_bootstrap.cc:654] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:49.301609 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:49.326779 23480 raft_consensus.cc:2379] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 4: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:49.309527 23679 raft_consensus.cc:2454] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:49.271850 23469 raft_consensus.cc:2454] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:49.280182 24315 raft_consensus.cc:686] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:49.251281 24356 raft_consensus.cc:482] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:49.281376 24519 raft_consensus.cc:2781] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:49.293929 24647 raft_consensus.cc:3037] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:49.281581 23429 leader_election.cc:302] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:49.322562 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:49.318671 23740 raft_consensus.cc:348] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.331490 23740 raft_consensus.cc:374] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:49.331867 23740 raft_consensus.cc:729] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:49.321554 23677 raft_consensus.cc:3037] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:49.293602 24607 raft_consensus.cc:2781] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:38:49.322599 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:49.302639 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:49.293428 24279 raft_consensus.cc:482] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:49.332732 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 51260.7us
I20260807 13:38:49.318279 24345 raft_consensus.cc:482] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:49.341495 23429 leader_election.cc:302] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:49.335901 23532 leader_election.cc:302] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:49.294803 24636 raft_consensus.cc:504] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.335549 23740 consensus_queue.cc:260] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.342659 23429 leader_election.cc:302] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:49.330842 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:49.336515 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:49.329866 24699 raft_consensus.cc:2781] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:49.349207 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:49.336835 24660 raft_consensus.cc:2781] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:49.329485 24593 raft_consensus.cc:504] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.351462 23479 raft_consensus.cc:2379] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 2: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:49.334676 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:49.339174 24519 raft_consensus.cc:686] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:49.351922 24643 raft_consensus.cc:2781] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:49.342716 24345 raft_consensus.cc:3037] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:49.409313 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:49.366338 24578 consensus_queue.cc:1046] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:49.425297 23740 ts_tablet_manager.cc:1428] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.153s user 0.011s sys 0.000s
I20260807 13:38:49.347980 24507 raft_consensus.cc:2781] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:49.343282 24607 raft_consensus.cc:686] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:49.335071 24356 raft_consensus.cc:504] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.345288 24674 raft_consensus.cc:2781] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:38:49.368539 23478 raft_consensus.cc:2354] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3.
I20260807 13:38:49.350323 24279 raft_consensus.cc:504] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.432229 24315 consensus_queue.cc:237] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.357173 24660 raft_consensus.cc:482] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:49.429935 24507 raft_consensus.cc:482] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:49.427453 24643 raft_consensus.cc:482] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:49.422792 23572 raft_consensus.cc:2454] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:49.429776 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:49.342499 24573 consensus_queue.cc:1046] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260807 13:38:49.489346 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:49.346094 24306 consensus_queue.cc:1035] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.083s
I20260807 13:38:49.416667 24699 raft_consensus.cc:686] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:49.621372 24356 leader_election.cc:288] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:49.431874 24434 raft_consensus.cc:482] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:49.519757 23471 raft_consensus.cc:2396] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:38:49.540287 24519 consensus_queue.cc:237] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.685249 23739 tablet_bootstrap.cc:492] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:49.642201 24507 raft_consensus.cc:3037] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:38:49.629336 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 536416us
I20260807 13:38:49.498893 23577 raft_consensus.cc:1261] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260807 13:38:49.633173 24660 raft_consensus.cc:3037] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:49.683139 23740 tablet_bootstrap.cc:492] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:49.685974 23739 ts_tablet_manager.cc:1397] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.825s user 0.025s sys 0.025s
W20260807 13:38:49.628660 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 279656us
I20260807 13:38:49.689132 24434 raft_consensus.cc:504] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.688876 24699 consensus_queue.cc:237] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.693085 23677 raft_consensus.cc:2454] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
W20260807 13:38:49.721849 24595 consensus_meta.cc:287] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.549s user 0.011s sys 0.008s
I20260807 13:38:49.722342 24595 raft_consensus.cc:504] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.709808 24593 leader_election.cc:288] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:49.731160 24647 raft_consensus.cc:2726] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:49.641669 24714 raft_consensus.cc:482] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:49.698033 24279 leader_election.cc:288] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:49.700676 23575 raft_consensus.cc:2454] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:49.702035 24614 raft_consensus.cc:482] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:49.703312 24636 leader_election.cc:288] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:49.688869 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e552e0aa3f4433858116fa31ee8458" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:49.647043 24643 raft_consensus.cc:3037] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:38:49.675184 24708 log.cc:924] Time spent T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.248s user 0.000s sys 0.009s
I20260807 13:38:49.714634 24306 consensus_queue.cc:1046] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:49.716965 24710 consensus_queue.cc:1046] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260807 13:38:49.776284 23532 leader_election.cc:341] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:49.717458 23429 leader_election.cc:302] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:49.732563 23533 leader_election.cc:302] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:49.708319 24345 raft_consensus.cc:504] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.736883 24595 leader_election.cc:288] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:49.695623 23478 raft_consensus.cc:1261] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260807 13:38:49.686486 23475 raft_consensus.cc:1261] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260807 13:38:49.792312 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 74952.8us
I20260807 13:38:49.793473 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
W20260807 13:38:49.793638 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 61178.1us
W20260807 13:38:49.799114 23672 consensus_meta.cc:287] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.626s user 0.018s sys 0.000s
I20260807 13:38:49.800130 23478 raft_consensus.cc:1261] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:38:49.767251 24578 consensus_queue.cc:1225] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer 5e0ea5aa0c6d4846a5ccc9962342e17a log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260807 13:38:49.800449 24434 leader_election.cc:288] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:49.800655 23469 raft_consensus.cc:1261] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:49.808241 24595 raft_consensus.cc:2781] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:49.824290 24593 consensus_queue.cc:1035] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:49.777344 24647 raft_consensus.cc:482] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:49.832602 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:49.838663 23633 leader_election.cc:302] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:49.836432 23679 raft_consensus.cc:2454] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4.
I20260807 13:38:49.839313 23740 tablet_bootstrap.cc:654] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:49.780704 24614 raft_consensus.cc:504] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.844982 23633 leader_election.cc:302] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:49.750834 24714 raft_consensus.cc:504] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.841109 24279 raft_consensus.cc:2781] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:38:49.843691 24636 raft_consensus.cc:482] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:49.845408 23478 raft_consensus.cc:1226] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4. Ops: []
I20260807 13:38:49.783952 24607 consensus_queue.cc:237] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:38:49.880285 23739 raft_consensus.cc:348] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.886643 23739 raft_consensus.cc:374] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:49.886106 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:49.886966 23739 raft_consensus.cc:729] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:49.860229 23631 leader_election.cc:302] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:49.840410 24507 raft_consensus.cc:504] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.877871 24450 raft_consensus.cc:2781] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:49.889010 23739 consensus_queue.cc:260] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.882714 24279 raft_consensus.cc:686] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
W20260807 13:38:49.883330 24320 consensus_meta.cc:287] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.754s user 0.012s sys 0.009s
I20260807 13:38:49.878422 24728 raft_consensus.cc:3032] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Stepping down as leader of term 1
W20260807 13:38:49.895561 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 68398.9us
I20260807 13:38:49.879365 24719 raft_consensus.cc:482] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:49.913089 23580 raft_consensus.cc:2379] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 1: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:49.913831 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:49.845824 24647 raft_consensus.cc:504] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.919134 23739 ts_tablet_manager.cc:1428] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.210s user 0.008s sys 0.003s
I20260807 13:38:49.922163 24732 raft_consensus.cc:2781] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:38:49.895237 24450 raft_consensus.cc:482] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:49.890808 24417 raft_consensus.cc:482] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:49.926280 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:49.896260 24595 raft_consensus.cc:686] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:49.884804 24636 raft_consensus.cc:504] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.896262 24315 raft_consensus.cc:482] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:49.914710 24728 raft_consensus.cc:729] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:49.952953 24729 raft_consensus.cc:482] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:49.950271 23571 raft_consensus.cc:2454] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:38:49.949157 24450 raft_consensus.cc:3037] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:49.959048 23578 raft_consensus.cc:1261] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260807 13:38:49.884812 24720 consensus_queue.cc:1035] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260807 13:38:49.962561 24643 raft_consensus.cc:504] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.933307 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:49.926460 24722 raft_consensus.cc:2726] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:49.971870 24345 leader_election.cc:288] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:49.990070 23473 raft_consensus.cc:3032] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:49.989936 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:49.990509 23473 raft_consensus.cc:729] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:49.990597 24345 raft_consensus.cc:482] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:49.990723 23469 raft_consensus.cc:2454] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 0.
I20260807 13:38:49.991250 23739 tablet_bootstrap.cc:492] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:49.991161 24345 raft_consensus.cc:504] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.923353 23675 raft_consensus.cc:1261] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 1. (index mismatch)
W20260807 13:38:49.965131 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 46476.1us
W20260807 13:38:49.968463 24723 log.cc:924] Time spent T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.075s user 0.000s sys 0.000s
I20260807 13:38:49.969249 24595 consensus_queue.cc:237] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.950563 24732 raft_consensus.cc:686] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:50.002265 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:49.971184 24507 leader_election.cc:288] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:49.973675 23737 tablet_bootstrap.cc:492] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:49.974771 24315 raft_consensus.cc:504] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.005897 23737 ts_tablet_manager.cc:1397] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.955s user 0.020s sys 0.032s
I20260807 13:38:49.979522 24729 raft_consensus.cc:504] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:49.982476 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 122405us
I20260807 13:38:50.006992 23631 leader_election.cc:302] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:50.008312 23631 leader_election.cc:302] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters: 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:50.009338 24722 raft_consensus.cc:2726] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:38:50.010080 24722 raft_consensus.cc:2781] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:50.010439 24722 raft_consensus.cc:482] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:50.010957 24722 raft_consensus.cc:3037] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:49.983443 23633 leader_election.cc:302] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:50.012929 24657 raft_consensus.cc:2781] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:50.013470 24657 raft_consensus.cc:482] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:50.013959 24657 raft_consensus.cc:3037] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:50.014194 24747 consensus_queue.cc:1035] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:50.016776 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:50.017611 23671 raft_consensus.cc:2454] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:50.020296 23577 raft_consensus.cc:1261] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:50.021978 23737 raft_consensus.cc:348] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.022910 23737 raft_consensus.cc:374] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:50.023245 23737 raft_consensus.cc:729] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:49.989622 23478 raft_consensus.cc:1261] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260807 13:38:49.964546 24721 raft_consensus.cc:482] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:49.993513 23429 leader_election.cc:302] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:49.998231 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:50.002393 24732 consensus_queue.cc:237] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.005483 23676 raft_consensus.cc:2379] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:50.023280 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:49.991422 23473 consensus_queue.cc:260] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.047533 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:50.026168 23631 leader_election.cc:302] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:50.049364 23631 leader_election.cc:302] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:50.029754 23478 pending_rounds.cc:76] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613: Aborting all ops after (but not including) 1
I20260807 13:38:50.058713 23681 raft_consensus.cc:1226] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:49.921455 24719 raft_consensus.cc:504] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:49.993108 23572 raft_consensus.cc:1261] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260807 13:38:49.953094 24417 raft_consensus.cc:504] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.061604 24660 raft_consensus.cc:504] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:50.062325 23631 leader_election.cc:341] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:50.028851 23737 consensus_queue.cc:260] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.063473 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:50.055994 23429 leader_election.cc:302] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:50.068929 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:50.070048 23681 raft_consensus.cc:2379] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 2: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:50.063338 23631 leader_election.cc:302] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:50.082569 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "356c6b3e51454d418acaa9be70bb9689" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:50.059036 23478 pending_rounds.cc:97] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260807 13:38:50.092422 23680 raft_consensus.cc:1226] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4. Ops: []
I20260807 13:38:50.058863 24653 raft_consensus.cc:2781] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:50.059253 24720 raft_consensus.cc:3037] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:50.103261 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:50.073173 23473 raft_consensus.cc:3037] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:50.104890 23679 raft_consensus.cc:3037] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:49.994515 24279 consensus_queue.cc:237] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.082163 24714 leader_election.cc:288] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:50.105931 24607 raft_consensus.cc:2726] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:50.088356 23471 raft_consensus.cc:1226] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 2. Current term is 3. Ops: []
I20260807 13:38:50.111487 24647 leader_election.cc:288] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:50.089033 24593 raft_consensus.cc:482] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:50.111300 24744 consensus_queue.cc:1035] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260807 13:38:50.095009 23478 raft_consensus.cc:2866] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:38:50.112581 24740 raft_consensus.cc:482] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:50.113394 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:50.009341 24751 consensus_queue.cc:1035] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.106s
I20260807 13:38:50.114202 23571 raft_consensus.cc:1226] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:38:50.117504 23469 raft_consensus.cc:2379] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:50.066138 24595 consensus_queue.cc:1035] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.049s
I20260807 13:38:50.044003 24721 raft_consensus.cc:504] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.114802 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:50.121065 24653 raft_consensus.cc:686] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:50.132701 24417 leader_election.cc:288] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:50.086267 24507 consensus_queue.cc:1035] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260807 13:38:50.114984 24573 consensus_queue.cc:1035] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260807 13:38:50.137220 24732 consensus_queue.cc:1035] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.023s
I20260807 13:38:50.159763 24738 consensus_queue.cc:1046] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260807 13:38:50.160868 24729 leader_election.cc:288] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:50.161199 24643 leader_election.cc:288] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:50.044967 24728 consensus_queue.cc:260] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.133103 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:50.196480 23679 raft_consensus.cc:2454] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:50.198407 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:50.199302 23679 raft_consensus.cc:3037] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 3
I20260807 13:38:50.200790 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
W20260807 13:38:50.149049 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 85779.3us
W20260807 13:38:50.148535 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 85550.1us
W20260807 13:38:50.165478 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 109573us
I20260807 13:38:50.166126 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:50.180711 24315 leader_election.cc:288] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:50.173270 24751 raft_consensus.cc:2781] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:38:50.183218 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9fcdd060ef64874a8719c95b2325942" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:50.184221 24660 leader_election.cc:288] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:50.120720 24674 raft_consensus.cc:686] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:50.203203 23676 raft_consensus.cc:2379] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 2: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:50.213979 23675 raft_consensus.cc:2379] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 1: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
W20260807 13:38:50.214320 24758 log.cc:924] Time spent T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.052s user 0.001s sys 0.000s
I20260807 13:38:50.214962 24762 consensus_queue.cc:1035] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260807 13:38:50.207629 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:50.218631 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:50.219969 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:50.211786 24751 raft_consensus.cc:482] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:50.220695 23580 raft_consensus.cc:2454] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:50.221696 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:50.205096 23429 leader_election.cc:302] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:50.196676 24746 raft_consensus.cc:482] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:50.181819 24636 leader_election.cc:288] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:50.162631 24740 raft_consensus.cc:504] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.206173 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:50.162287 24593 raft_consensus.cc:504] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.207367 24721 leader_election.cc:288] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:50.181595 24345 leader_election.cc:288] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:50.138053 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:50.220773 24751 raft_consensus.cc:3037] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:50.205227 23631 leader_election.cc:398] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Vote denied by peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037) with higher term. Message: Invalid argument: T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3.
I20260807 13:38:50.239880 23737 ts_tablet_manager.cc:1428] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.233s user 0.019s sys 0.039s
I20260807 13:38:50.269690 23631 leader_election.cc:401] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:38:50.271534 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:50.272086 23739 tablet_bootstrap.cc:654] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:50.273252 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:50.273412 24772 raft_consensus.cc:2781] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:50.274047 24772 raft_consensus.cc:482] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:50.274413 24772 raft_consensus.cc:3037] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:50.274796 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:50.276546 24764 log.cc:924] Time spent T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
I20260807 13:38:50.277971 24636 raft_consensus.cc:482] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:50.278540 24636 raft_consensus.cc:504] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.281121 24636 leader_election.cc:288] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:50.281239 24721 raft_consensus.cc:482] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:50.208308 23575 raft_consensus.cc:2454] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:50.279352 23473 raft_consensus.cc:1261] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:50.284847 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9fcdd060ef64874a8719c95b2325942" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:50.293172 23684 raft_consensus.cc:2379] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 1: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:50.294001 23740 tablet_bootstrap.cc:492] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:50.294634 23740 ts_tablet_manager.cc:1397] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.648s user 0.031s sys 0.029s
I20260807 13:38:50.288816 24772 raft_consensus.cc:504] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.291522 23580 raft_consensus.cc:2454] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:50.299320 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:50.300104 23580 raft_consensus.cc:2454] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:50.287271 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
W20260807 13:38:50.297160 23430 leader_election.cc:334] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Timed out: RequestConsensusVote RPC to 127.21.69.2:33363 timed out after 2.155s (SENT)
W20260807 13:38:50.319114 24485 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260807 13:38:50.321208 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
W20260807 13:38:50.312343 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 107246us
I20260807 13:38:50.314366 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:50.322381 23631 leader_election.cc:302] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:50.323062 23580 raft_consensus.cc:2379] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 3: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
W20260807 13:38:50.324290 24519 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s user 0.006s sys 0.011s
I20260807 13:38:50.312769 23430 leader_election.cc:302] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:50.324622 24772 leader_election.cc:288] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:50.325623 23679 raft_consensus.cc:2454] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
W20260807 13:38:50.325314 24519 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s user 0.007s sys 0.011s
I20260807 13:38:50.282202 24653 consensus_queue.cc:237] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.255162 24657 raft_consensus.cc:504] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.337548 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:50.319391 23572 raft_consensus.cc:3037] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:50.332201 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4996c3c52ccc41b9a8da11ca747a8e6a" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:50.356912 24607 raft_consensus.cc:482] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:50.357568 24607 raft_consensus.cc:504] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:50.359112 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 62006.2us
I20260807 13:38:50.359989 24775 raft_consensus.cc:482] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:50.360514 24775 raft_consensus.cc:504] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.362493 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:50.362923 24775 leader_election.cc:288] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:50.363266 23472 raft_consensus.cc:2454] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:50.363528 24772 raft_consensus.cc:2726] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:50.363751 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39707c5d97164544b9f5c03db41181c0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:50.364511 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:50.366629 24593 leader_election.cc:288] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:50.368463 24740 leader_election.cc:288] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:50.301949 24722 raft_consensus.cc:504] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.312219 23574 raft_consensus.cc:2454] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:50.370096 23631 leader_election.cc:302] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters: 9ae273efd33642ad970ab8d1973917c1
W20260807 13:38:50.371428 23631 consensus_peers.cc:487] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a -> Peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Couldn't send request to peer e11cad1eeaf5424c94e51241096f6613. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:38:50.373194 23633 leader_election.cc:302] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:50.328564 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:50.336092 24647 raft_consensus.cc:2726] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037) with higher term. Message: Invalid argument: T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3.
I20260807 13:38:50.380542 23684 raft_consensus.cc:2379] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 2: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:50.255471 24746 raft_consensus.cc:504] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.301126 24721 raft_consensus.cc:504] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.332619 24719 leader_election.cc:288] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:50.398909 24356 raft_consensus.cc:3032] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:38:50.399456 24356 raft_consensus.cc:729] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:50.369609 24747 raft_consensus.cc:2726] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:50.366622 24748 raft_consensus.cc:482] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:50.400501 24356 consensus_queue.cc:260] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.400738 24748 raft_consensus.cc:504] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.401410 24657 leader_election.cc:288] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:50.402031 24356 raft_consensus.cc:3037] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:50.402212 24771 raft_consensus.cc:2781] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:50.403239 24748 leader_election.cc:288] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:50.404608 24720 raft_consensus.cc:2726] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:38:50.332204 24732 consensus_queue.cc:1035] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260807 13:38:50.399492 24773 raft_consensus.cc:2726] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:38:50.394452 23479 raft_consensus.cc:1226] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4. Ops: []
I20260807 13:38:50.415256 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b078a19f38494b04ad11b14d98ec4bca" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:50.387415 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:50.364425 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:50.425331 23532 leader_election.cc:302] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:50.364480 23469 raft_consensus.cc:2454] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:50.458133 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:50.380076 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "356c6b3e51454d418acaa9be70bb9689" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:50.375161 24607 leader_election.cc:288] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:50.485560 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:50.486809 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:50.376245 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e552e0aa3f4433858116fa31ee8458" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:50.487471 23580 raft_consensus.cc:2454] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:50.486828 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:50.425904 24740 raft_consensus.cc:482] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:50.417699 24771 raft_consensus.cc:482] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:50.506574 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220c24fa0c52459182e1e89c74331f3b" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:50.520504 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:50.480521 23478 raft_consensus.cc:3037] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:50.485273 24720 raft_consensus.cc:2781] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:50.521783 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:50.332468 24674 consensus_queue.cc:237] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.520526 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:50.528760 23479 raft_consensus.cc:2454] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
I20260807 13:38:50.481848 24593 raft_consensus.cc:2781] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:50.484731 24773 raft_consensus.cc:482] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:50.481493 24728 raft_consensus.cc:3037] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:50.462983 24450 raft_consensus.cc:504] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:50.525272 23532 leader_election.cc:341] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:50.536653 23532 leader_election.cc:302] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:50.482991 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:50.534796 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:50.533823 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:50.533222 23571 raft_consensus.cc:2454] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:50.539903 23679 raft_consensus.cc:2454] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4.
I20260807 13:38:50.541074 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9fcdd060ef64874a8719c95b2325942" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:50.541451 23429 leader_election.cc:302] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:50.542006 23571 raft_consensus.cc:2379] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 1: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:50.542343 24762 raft_consensus.cc:2781] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:38:50.542925 24762 raft_consensus.cc:482] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:50.543002 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:50.531594 24593 raft_consensus.cc:482] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:50.541153 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:50.543488 24762 raft_consensus.cc:3037] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:50.544431 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9fcdd060ef64874a8719c95b2325942" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:50.521297 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 148152us
I20260807 13:38:50.527315 24720 raft_consensus.cc:482] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:50.524906 24771 raft_consensus.cc:3037] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:50.527872 24740 raft_consensus.cc:504] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.549149 23679 raft_consensus.cc:2454] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:50.537986 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:50.529911 24519 consensus_queue.cc:1046] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260807 13:38:50.562496 24507 raft_consensus.cc:2781] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:50.565047 23429 leader_election.cc:302] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:50.562924 24720 raft_consensus.cc:3037] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:50.561887 23580 raft_consensus.cc:2379] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 1: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:50.558634 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:50.539691 24773 raft_consensus.cc:504] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.556375 24593 raft_consensus.cc:3037] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:38:50.649690 23430 leader_election.cc:334] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Timed out: RequestConsensusVote RPC to 127.21.69.2:33363 timed out after 1.562s (SENT)
I20260807 13:38:50.706284 23430 leader_election.cc:302] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
W20260807 13:38:50.613013 23407 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260807 13:38:50.707325 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 57680us
I20260807 13:38:50.707666 23740 raft_consensus.cc:348] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.558441 23572 raft_consensus.cc:2454] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:50.702783 24636 raft_consensus.cc:482] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:50.627628 23344 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41372 (request call id 67) took 8299 ms. Trace:
W20260807 13:38:50.608999 24779 log.cc:924] Time spent T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.052s user 0.001s sys 0.000s
I20260807 13:38:50.709338 23740 raft_consensus.cc:374] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:50.650444 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:50.611579 24776 log.cc:924] Time spent T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.090s user 0.000s sys 0.000s
I20260807 13:38:50.722333 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:50.627189 24785 log.cc:924] Time spent T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.061s user 0.000s sys 0.000s
I20260807 13:38:50.714787 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
W20260807 13:38:50.669075 24786 log.cc:924] Time spent T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.056s user 0.000s sys 0.000s
I20260807 13:38:50.669675 24740 leader_election.cc:288] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:50.672327 23532 leader_election.cc:302] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:50.717702 24636 raft_consensus.cc:504] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.721098 24782 raft_consensus.cc:482] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:50.692735 23478 raft_consensus.cc:2454] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:50.720901 24771 raft_consensus.cc:504] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.651834 24320 raft_consensus.cc:482] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:50.574146 24507 raft_consensus.cc:482] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:50.610577 24751 raft_consensus.cc:504] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.584793 24434 raft_consensus.cc:482] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:50.608740 24777 log.cc:924] Time spent T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.080s user 0.000s sys 0.000s
I20260807 13:38:50.668284 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:50.631031 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:50.613341 24645 raft_consensus.cc:3032] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:50.667153 24721 leader_election.cc:288] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:50.696587 24744 raft_consensus.cc:482] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:50.672402 24450 leader_election.cc:288] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:50.626762 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:50.718360 23740 raft_consensus.cc:729] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:50.769167 23574 raft_consensus.cc:2362] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3. Re-sending same reply.
I20260807 13:38:50.768959 24744 raft_consensus.cc:504] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.769495 23740 consensus_queue.cc:260] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.770185 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:50.771133 24744 leader_election.cc:288] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:50.771272 23740 ts_tablet_manager.cc:1428] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.476s user 0.012s sys 0.023s
I20260807 13:38:50.760708 24507 raft_consensus.cc:3037] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:50.669325 24729 raft_consensus.cc:3032] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:38:50.582556 24345 raft_consensus.cc:2781] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260807 13:38:50.737239 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 364823us
I20260807 13:38:50.726848 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6ae70649fa43bba8052b66977418f5" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:50.759145 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 86896.1us
I20260807 13:38:50.674815 24578 raft_consensus.cc:3032] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:50.714861 24356 raft_consensus.cc:2726] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:50.765218 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:50.762245 24657 raft_consensus.cc:482] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:50.773597 23473 raft_consensus.cc:1226] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260807 13:38:50.727175 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:50.799188 23679 raft_consensus.cc:2454] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:38:50.800649 24636 leader_election.cc:288] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:50.800869 23572 raft_consensus.cc:2379] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 1: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:50.802122 24657 raft_consensus.cc:504] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.804414 24657 leader_election.cc:288] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:50.802601 24751 leader_election.cc:288] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:50.805361 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39707c5d97164544b9f5c03db41181c0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:50.807775 24614 leader_election.cc:288] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:50.761060 24320 raft_consensus.cc:504] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.808780 24578 raft_consensus.cc:729] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:50.808270 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:50.810143 24320 leader_election.cc:288] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:50.810756 23580 raft_consensus.cc:2379] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 4: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:50.812233 23470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 409) took 1482 ms. Trace:
I20260807 13:38:50.716487 23344 rpcz_store.cc:276] 0807 13:38:42.328039 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:42.330640 (+ 2601us) service_pool.cc:227] Handling call
0807 13:38:50.627536 (+8296896us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:38:49.023078 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:38:49.023852 (+ 774us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:38:49.023891 (+ 39us) write_op.cc:435] Acquired schema lock
0807 13:38:49.023916 (+ 25us) tablet.cc:660] Decoding operations
0807 13:38:49.048043 (+ 24127us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:38:49.048130 (+ 87us) write_op.cc:641] Partition lock acquired for write op
0807 13:38:49.048157 (+ 27us) tablet.cc:683] Acquiring locks for 2 operations
0807 13:38:49.048527 (+ 370us) tablet.cc:699] Row locks acquired
0807 13:38:49.048553 (+ 26us) write_op.cc:260] PREPARE: finished
0807 13:38:49.048699 (+ 146us) write_op.cc:270] Start()
0807 13:38:49.048823 (+ 124us) write_op.cc:276] Timestamp: P: 1786109929048659 usec, L: 0
0807 13:38:49.048846 (+ 23us) op_driver.cc:331] REPLICATION: starting
0807 13:38:49.049568 (+ 722us) log.cc:842] Serialized 916 byte log entry
0807 13:38:49.254235 (+204667us) op_driver.cc:444] REPLICATION: finished
0807 13:38:49.684038 (+429803us) write_op.cc:301] APPLY: starting
0807 13:38:49.687488 (+ 3450us) tablet.cc:1365] starting BulkCheckPresence
0807 13:38:49.687665 (+ 177us) tablet.cc:1368] finished BulkCheckPresence
0807 13:38:49.687816 (+ 151us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:38:49.688154 (+ 338us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:38:49.688323 (+ 169us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0807 13:38:49.688372 (+ 49us) write_op.cc:312] APPLY: finished
0807 13:38:49.688604 (+ 232us) log.cc:842] Serialized 28 byte log entry
0807 13:38:49.688797 (+ 193us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:38:49.688898 (+ 101us) write_op.cc:454] Released schema lock
0807 13:38:49.688937 (+ 39us) write_op.cc:341] FINISH: Updating metrics
0807 13:38:49.689211 (+ 274us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:38:49.689243 (+ 32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":142044,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":410766,"apply.run_cpu_time_us":2225,"apply.run_wall_time_us":5514,"num_ops":2,"prepare.queue_time_us":86903,"prepare.run_cpu_time_us":3318,"prepare.run_wall_time_us":52875,"replication_time_us":194518,"thread_start_us":349795,"threads_started":2}]]}
I20260807 13:38:50.771384 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:50.813184 23739 tablet_bootstrap.cc:492] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:50.812748 23470 rpcz_store.cc:276] 0807 13:38:49.329826 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:49.348212 (+ 18386us) service_pool.cc:227] Handling call
0807 13:38:50.630820 (+1282608us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b5800003398. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:50.812126 (+181306us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4309888}
I20260807 13:38:50.813655 23739 ts_tablet_manager.cc:1397] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.823s user 0.027s sys 0.027s
I20260807 13:38:50.813649 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:50.814103 24744 raft_consensus.cc:482] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:50.811663 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:50.812314 24773 leader_election.cc:288] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:50.815691 23429 leader_election.cc:302] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:50.811136 23582 raft_consensus.cc:2454] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4.
I20260807 13:38:50.816049 23679 raft_consensus.cc:3037] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:50.820026 24744 raft_consensus.cc:504] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.820662 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:50.821503 23574 raft_consensus.cc:2379] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:50.822274 24744 leader_election.cc:288] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:50.822398 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:50.822197 23739 raft_consensus.cc:348] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.823822 23739 raft_consensus.cc:374] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:50.824249 23739 raft_consensus.cc:729] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:50.824419 23740 tablet_bootstrap.cc:492] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:50.828250 23681 raft_consensus.cc:2454] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
I20260807 13:38:50.830331 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:50.823529 23571 raft_consensus.cc:2454] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:50.807807 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:50.833674 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:50.833834 23672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 347) took 1737 ms. Trace:
I20260807 13:38:50.767048 24645 raft_consensus.cc:729] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:50.834381 23571 raft_consensus.cc:2454] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:38:50.759838 24782 raft_consensus.cc:504] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.834285 23672 rpcz_store.cc:276] 0807 13:38:49.096032 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:49.172017 (+ 75985us) service_pool.cc:227] Handling call
0807 13:38:49.172453 (+ 436us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:49.823949 (+651496us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:49.828236 (+ 4287us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:50.185352 (+357116us) spinlock_profiling.cc:243] Waited 4.28 ms on lock 0x7b2c000a2b08. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc696a42e11 00007fc696a52442 00007fc69809ac11 00007fc69805f58a 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772
0807 13:38:50.185783 (+ 431us) log.cc:842] Serialized 26 byte log entry
0807 13:38:50.214907 (+ 29124us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b18001197a0. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc69dfd68b1 00007fc69dfe3661 00007fc695137764 00007fc69513ab11 00007fc69513aac9 00007fc69513aa59 00007fc69513aa21 00007fc695139d1d 00007fc69e39b204 00007fc69e39b039 00007fc695119dc6
0807 13:38:50.367103 (+152196us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:38:50.367146 (+ 43us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:50.367241 (+ 95us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:50.833567 (+466326us) raft_consensus.cc:1671] finished
0807 13:38:50.833589 (+ 22us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:50.833732 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1792,"raft.queue_time_us":35885,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":4596,"spinlock_wait_cycles":37652096,"thread_start_us":180830,"threads_started":1,"wal-append.queue_time_us":279706}
I20260807 13:38:50.836242 24771 leader_election.cc:288] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:50.836978 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:50.837531 24789 raft_consensus.cc:482] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:50.837692 23672 raft_consensus.cc:3037] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:50.838105 24789 raft_consensus.cc:504] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.823354 24450 raft_consensus.cc:482] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:50.824842 24729 raft_consensus.cc:729] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:50.742496 24762 raft_consensus.cc:504] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.767356 23676 raft_consensus.cc:3037] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:50.833822 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:50.835011 24645 consensus_queue.cc:260] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.847000 24636 raft_consensus.cc:482] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:50.847235 24645 raft_consensus.cc:3037] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:50.840916 23739 consensus_queue.cc:260] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.842891 23532 leader_election.cc:302] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:50.798100 24345 raft_consensus.cc:482] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:50.850652 23737 tablet_bootstrap.cc:492] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
W20260807 13:38:50.850803 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 51838.7us
I20260807 13:38:50.848776 24782 leader_election.cc:288] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:50.850512 24614 consensus_queue.cc:1035] T 4da43081a61b4d25bbd028722bd1223c P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260807 13:38:50.854475 24744 consensus_queue.cc:1035] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:38:50.854722 23470 raft_consensus.cc:1261] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260807 13:38:50.855186 23470 pending_rounds.cc:76] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613: Aborting all ops after (but not including) 1
I20260807 13:38:50.855434 23470 pending_rounds.cc:97] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260807 13:38:50.831322 24752 raft_consensus.cc:2781] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:38:50.847586 24636 raft_consensus.cc:504] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.858074 24636 leader_election.cc:288] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:50.765144 24434 raft_consensus.cc:504] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.847846 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:50.859357 23572 raft_consensus.cc:2379] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 2: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:50.860153 24434 leader_election.cc:288] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:50.851419 24450 raft_consensus.cc:504] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.859292 23470 raft_consensus.cc:2866] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:38:50.861603 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:50.862237 23572 raft_consensus.cc:2454] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4.
I20260807 13:38:50.835484 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:50.878966 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:50.832261 24721 raft_consensus.cc:2781] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:50.810173 24578 consensus_queue.cc:260] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.869261 24740 raft_consensus.cc:2781] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:50.898809 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:50.881872 24437 raft_consensus.cc:3032] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:38:50.840646 24356 raft_consensus.cc:482] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:50.884604 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:50.863057 24345 raft_consensus.cc:3037] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:50.924463 23679 raft_consensus.cc:2396] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:38:50.840198 24320 consensus_queue.cc:1035] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.086s
I20260807 13:38:50.959156 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:50.919237 24437 raft_consensus.cc:729] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:50.964452 24437 consensus_queue.cc:260] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.965611 24437 raft_consensus.cc:3037] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:38:50.968565 24787 log.cc:924] Time spent T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.204s user 0.000s sys 0.001s
I20260807 13:38:50.932785 24578 raft_consensus.cc:3037] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:50.969843 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:50.970642 23671 raft_consensus.cc:2362] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3. Re-sending same reply.
I20260807 13:38:50.972430 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:50.973671 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:50.974303 23582 raft_consensus.cc:2454] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4.
I20260807 13:38:50.844743 24720 raft_consensus.cc:504] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:50.919802 24721 raft_consensus.cc:482] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:50.919303 23571 raft_consensus.cc:2362] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3. Re-sending same reply.
I20260807 13:38:51.053628 23739 ts_tablet_manager.cc:1428] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.239s user 0.017s sys 0.005s
I20260807 13:38:50.919773 23574 raft_consensus.cc:2362] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4. Re-sending same reply.
W20260807 13:38:51.050022 23430 leader_election.cc:334] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Timed out: RequestConsensusVote RPC to 127.21.69.2:33363 timed out after 1.739s (SENT)
I20260807 13:38:50.975106 24762 leader_election.cc:288] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:50.968636 23680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 359) took 1165 ms. Trace:
I20260807 13:38:51.067355 23680 rpcz_store.cc:276] 0807 13:38:49.803048 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:49.803214 (+ 166us) service_pool.cc:227] Handling call
0807 13:38:49.828541 (+ 25327us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:50.093006 (+264465us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:50.968375 (+875369us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b5400055354. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:50.968573 (+ 198us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":606245760}
I20260807 13:38:50.990387 23679 raft_consensus.cc:2379] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 4: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:50.934152 24740 raft_consensus.cc:686] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
W20260807 13:38:51.070888 23430 leader_election.cc:334] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Timed out: RequestConsensusVote RPC to 127.21.69.2:33363 timed out after 1.816s (SENT)
I20260807 13:38:51.081645 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39707c5d97164544b9f5c03db41181c0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:51.081969 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:51.082729 23671 raft_consensus.cc:3037] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:51.083017 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:51.083119 24720 leader_election.cc:288] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:50.975253 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:51.074973 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:51.083961 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:51.084649 23679 raft_consensus.cc:2379] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 1: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:51.048403 24450 leader_election.cc:288] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:51.050316 24417 raft_consensus.cc:482] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:51.086187 23680 raft_consensus.cc:2379] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:50.930853 24356 raft_consensus.cc:504] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.060549 24636 raft_consensus.cc:482] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:51.062062 24721 raft_consensus.cc:3037] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:51.060755 24647 raft_consensus.cc:482] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:51.063287 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:51.078416 24674 raft_consensus.cc:482] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:51.081663 24789 leader_election.cc:288] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:51.085424 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:51.053925 24729 consensus_queue.cc:260] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.104729 24674 raft_consensus.cc:504] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.098626 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:51.094048 24636 raft_consensus.cc:504] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.093276 24417 raft_consensus.cc:504] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.121898 24417 leader_election.cc:288] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:51.097898 24647 raft_consensus.cc:504] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.108865 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "608f7e63bc4648e0890e5f601c52736c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:51.130872 24674 leader_election.cc:288] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:51.112351 23572 raft_consensus.cc:2454] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:51.141667 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:51.142622 23571 raft_consensus.cc:2379] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 4: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:51.143285 23737 tablet_bootstrap.cc:654] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:51.144026 23674 raft_consensus.cc:2379] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 1: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:51.145545 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:51.146539 23571 raft_consensus.cc:2379] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 3: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:51.154225 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 232) took 1166 ms. Trace:
I20260807 13:38:51.154778 23480 rpcz_store.cc:276] 0807 13:38:49.987869 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:49.988989 (+ 1120us) service_pool.cc:227] Handling call
0807 13:38:49.989401 (+ 412us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:50.196424 (+207023us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:50.196467 (+ 43us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:50.196519 (+ 52us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:50.196562 (+ 43us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:51.153911 (+957349us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b5400292f54. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:51.153971 (+ 60us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:51.154144 (+ 173us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":475611904}
I20260807 13:38:51.157037 23740 tablet_bootstrap.cc:654] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:51.157667 23679 raft_consensus.cc:1226] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:51.153378 23676 raft_consensus.cc:2454] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4.
W20260807 13:38:51.158577 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 62800.2us
I20260807 13:38:51.136173 24729 raft_consensus.cc:3037] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:51.133572 24738 consensus_queue.cc:1035] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260807 13:38:51.185496 23533 leader_election.cc:302] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.148996 23578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 251) took 1129 ms. Trace:
I20260807 13:38:51.159607 24345 raft_consensus.cc:504] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.192972 24636 leader_election.cc:288] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:51.191109 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:51.191109 23671 raft_consensus.cc:2454] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 5.
I20260807 13:38:51.224225 23582 raft_consensus.cc:2362] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2. Re-sending same reply.
I20260807 13:38:51.224584 24437 raft_consensus.cc:2726] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:38:51.224817 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:51.225227 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9fcdd060ef64874a8719c95b2325942" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:51.225742 23671 raft_consensus.cc:2379] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 2: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:51.226049 23582 raft_consensus.cc:2379] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 1: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:51.226725 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:51.226938 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
W20260807 13:38:51.189993 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 115233us
I20260807 13:38:51.229907 24345 leader_election.cc:288] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:51.231123 23430 leader_election.cc:302] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
W20260807 13:38:51.195353 24766 log.cc:924] Time spent T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.983s user 0.003s sys 0.000s
I20260807 13:38:51.196112 24356 leader_election.cc:288] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:51.197675 24647 leader_election.cc:288] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:51.113157 24740 consensus_queue.cc:237] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.234457 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:51.200613 23633 leader_election.cc:302] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:51.235740 24674 raft_consensus.cc:2726] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:38:51.237172 24434 raft_consensus.cc:2781] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:51.237362 23633 leader_election.cc:302] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:51.238246 23430 leader_election.cc:302] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:51.239120 24652 raft_consensus.cc:2781] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:51.239902 24652 raft_consensus.cc:482] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:51.240559 24652 raft_consensus.cc:3037] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:51.241488 24674 raft_consensus.cc:2726] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:38:51.242794 23430 leader_election.cc:302] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:51.186559 23674 raft_consensus.cc:1226] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4. Ops: []
I20260807 13:38:51.244026 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:51.244966 23480 raft_consensus.cc:2454] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:51.245558 23674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 384) took 1179 ms. Trace:
I20260807 13:38:51.246029 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:51.246003 23674 rpcz_store.cc:276] 0807 13:38:50.066461 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:51.144782 (+1078321us) service_pool.cc:227] Handling call
0807 13:38:51.176951 (+ 32169us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:51.244026 (+ 67075us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:51.245301 (+ 1275us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b540018b0d0. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ea09 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:51.245480 (+ 179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":69231872}
I20260807 13:38:51.150534 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:51.247992 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "608f7e63bc4648e0890e5f601c52736c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:51.147593 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6ae70649fa43bba8052b66977418f5" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:51.249143 24716 log.cc:924] Time spent T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 1.561s user 0.005s sys 0.000s
I20260807 13:38:51.249284 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:51.249941 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:51.250489 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:51.210606 23679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 382) took 1145 ms. Trace:
I20260807 13:38:51.252066 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:51.251376 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:51.253235 23470 raft_consensus.cc:2379] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:51.240458 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:51.243558 24674 raft_consensus.cc:2726] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:51.247536 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b078a19f38494b04ad11b14d98ec4bca" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:51.253166 23571 raft_consensus.cc:2362] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3. Re-sending same reply.
I20260807 13:38:51.247565 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:51.252111 23679 rpcz_store.cc:276] 0807 13:38:50.065729 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:51.085175 (+1019446us) service_pool.cc:227] Handling call
0807 13:38:51.098372 (+ 13197us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:51.158372 (+ 60000us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:51.210273 (+ 51901us) spinlock_profiling.cc:243] Waited 58.8 ms on lock 0x7b54002c97d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:51.210532 (+ 259us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":135352192}
I20260807 13:38:51.223244 24722 leader_election.cc:288] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:51.237634 24434 raft_consensus.cc:482] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:51.218592 23533 leader_election.cc:302] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.269694 23430 leader_election.cc:302] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:51.211391 24806 raft_consensus.cc:482] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:51.391115 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 172648us
I20260807 13:38:51.392556 23533 leader_election.cc:302] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
W20260807 13:38:51.394389 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 124782us
I20260807 13:38:51.181851 24593 raft_consensus.cc:504] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.396919 23430 leader_election.cc:302] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:51.254448 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:51.399823 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220c24fa0c52459182e1e89c74331f3b" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:51.208820 24507 raft_consensus.cc:504] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.402007 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:51.462877 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:51.388414 24434 raft_consensus.cc:3037] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:51.386270 24636 raft_consensus.cc:482] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:51.485112 23580 raft_consensus.cc:2454] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:51.398801 24732 raft_consensus.cc:482] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:51.481033 24320 raft_consensus.cc:2726] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:51.480341 23479 raft_consensus.cc:2379] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 1: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:51.488029 24732 raft_consensus.cc:504] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.489678 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:51.487674 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:51.398518 24437 raft_consensus.cc:2726] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:51.490545 23479 raft_consensus.cc:2379] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 2: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:51.231627 24345 consensus_queue.cc:1035] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.179s
I20260807 13:38:51.500742 23679 raft_consensus.cc:1226] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:51.501703 23679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 365) took 1226 ms. Trace:
I20260807 13:38:51.502601 23679 rpcz_store.cc:276] 0807 13:38:50.274955 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:51.421052 (+1146097us) service_pool.cc:227] Handling call
0807 13:38:51.500478 (+ 79426us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:51.501374 (+ 896us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:51.501626 (+ 252us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:51.505705 23679 raft_consensus.cc:1226] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:51.402627 24674 raft_consensus.cc:2726] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:38:51.408113 24578 raft_consensus.cc:2781] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:38:51.401283 24804 raft_consensus.cc:482] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
W20260807 13:38:51.471254 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 78784.8us
I20260807 13:38:51.512104 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:51.496301 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:51.490566 24732 leader_election.cc:288] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:51.492794 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:51.544456 24507 leader_election.cc:288] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:51.544584 23671 raft_consensus.cc:2454] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
I20260807 13:38:51.545868 23671 raft_consensus.cc:1226] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:51.546490 23671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 367) took 1271 ms. Trace:
I20260807 13:38:51.546795 23671 rpcz_store.cc:276] 0807 13:38:50.275573 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:51.545302 (+1269729us) service_pool.cc:227] Handling call
0807 13:38:51.545690 (+ 388us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:51.546234 (+ 544us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:51.546415 (+ 181us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:51.528581 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:51.548519 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faff067df57c4de49e89824bbc248751" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:51.549674 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:51.550256 23479 raft_consensus.cc:3037] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:51.538743 24578 raft_consensus.cc:482] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:51.552116 24578 raft_consensus.cc:3037] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:51.533519 23679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 366) took 1258 ms. Trace:
I20260807 13:38:51.556594 23679 rpcz_store.cc:276] 0807 13:38:50.275251 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:51.505017 (+1229766us) service_pool.cc:227] Handling call
0807 13:38:51.505456 (+ 439us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:51.533153 (+ 27697us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:51.533440 (+ 287us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:51.518095 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:51.540247 23533 leader_election.cc:302] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.529660 23575 raft_consensus.cc:2379] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 1: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:51.498499 24636 raft_consensus.cc:504] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.398572 24806 raft_consensus.cc:504] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:51.561448 23533 leader_election.cc:341] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:51.581352 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:51.533176 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:51.568789 23631 leader_election.cc:302] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.576953 24722 raft_consensus.cc:482] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:51.586539 23631 leader_election.cc:302] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.591312 23631 leader_election.cc:302] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.593405 23429 leader_election.cc:302] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:51.581641 24507 raft_consensus.cc:2726] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:51.596825 23429 leader_election.cc:302] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:51.582422 23533 leader_election.cc:302] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.564713 23679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 370) took 1267 ms. Trace:
I20260807 13:38:51.586011 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:51.599431 23429 leader_election.cc:302] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:51.599853 23533 leader_election.cc:302] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.600449 23480 raft_consensus.cc:2396] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:38:51.597229 24485 raft_consensus.cc:2781] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:38:51.594957 23631 leader_election.cc:302] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.560187 23478 raft_consensus.cc:2454] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:38:51.583022 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:51.586637 24674 raft_consensus.cc:482] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:51.599241 23679 rpcz_store.cc:276] 0807 13:38:50.291242 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:51.557598 (+1266356us) service_pool.cc:227] Handling call
0807 13:38:51.557989 (+ 391us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:51.558154 (+ 165us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:51.558177 (+ 23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:51.558216 (+ 39us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:51.558243 (+ 27us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:51.558288 (+ 45us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:51.558421 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:51.577214 23479 raft_consensus.cc:2454] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:38:51.612447 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:51.612787 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:51.613200 23679 raft_consensus.cc:3037] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:51.591833 24450 raft_consensus.cc:2726] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:38:51.593832 24744 raft_consensus.cc:2726] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:38:51.607517 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:51.608739 23533 leader_election.cc:302] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.584501 24732 consensus_queue.cc:1035] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260807 13:38:51.543267 24804 raft_consensus.cc:504] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.613716 23479 raft_consensus.cc:2454] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:38:51.593231 24722 raft_consensus.cc:504] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.603420 24762 raft_consensus.cc:2726] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:51.603065 23671 raft_consensus.cc:1226] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:51.216207 23578 rpcz_store.cc:276] 0807 13:38:50.019596 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:50.025955 (+ 6359us) service_pool.cc:227] Handling call
0807 13:38:50.088326 (+ 62371us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:50.133111 (+ 44785us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:50.133167 (+ 56us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:50.156861 (+ 23694us) log.cc:842] Serialized 26 byte log entry
0807 13:38:50.800649 (+643788us) spinlock_profiling.cc:243] Waited 7.67 ms on lock 0x7b1800060a60. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc69dfd68b1 00007fc69dfe3661 00007fc695119345 00007fc69df50a39 00007fc6951368bb 00007fc695134cbf 00007fc695136e22 00007fc697ce05bb 00007fc697ce6063 00007fc697ce6411 00007fc6980335cf
0807 13:38:50.928932 (+128283us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:38:50.935841 (+ 6909us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:50.960964 (+ 25123us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:51.148621 (+187657us) raft_consensus.cc:1671] finished
0807 13:38:51.148660 (+ 39us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:51.148917 (+ 257us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":8018,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":20697,"spinlock_wait_cycles":17641856,"thread_start_us":116140,"threads_started":1,"wal-append.queue_time_us":938111}
I20260807 13:38:51.631114 23533 leader_election.cc:302] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.650967 23533 leader_election.cc:302] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.595956 24356 consensus_queue.cc:1046] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260807 13:38:51.610954 24507 raft_consensus.cc:2726] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:51.639850 23680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 383) took 1573 ms. Trace:
I20260807 13:38:51.612290 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:51.617646 24345 raft_consensus.cc:2781] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader election won for term 5
W20260807 13:38:51.652676 23533 leader_election.cc:341] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:51.619259 24740 raft_consensus.cc:2726] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260807 13:38:51.634918 23672 consensus_meta.cc:287] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.797s user 0.013s sys 0.000s
W20260807 13:38:51.625979 24721 consensus_meta.cc:287] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.527s user 0.005s sys 0.005s
I20260807 13:38:51.615371 24593 leader_election.cc:288] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:51.656708 23680 rpcz_store.cc:276] 0807 13:38:50.066103 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:51.090794 (+1024691us) service_pool.cc:227] Handling call
0807 13:38:51.097871 (+ 7077us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:51.103513 (+ 5642us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:51.103546 (+ 33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:51.107240 (+ 3694us) log.cc:842] Serialized 26 byte log entry
0807 13:38:51.210740 (+103500us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:38:51.210778 (+ 38us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:51.210847 (+ 69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:51.639573 (+428726us) raft_consensus.cc:1671] finished
0807 13:38:51.639599 (+ 26us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:51.639783 (+ 184us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2868,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":3288,"thread_start_us":101019,"threads_started":1,"wal-append.queue_time_us":430455}
I20260807 13:38:51.647159 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:51.615587 24417 raft_consensus.cc:2726] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:51.659080 23737 tablet_bootstrap.cc:492] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:51.616261 24485 raft_consensus.cc:686] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 4 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:51.666836 23737 ts_tablet_manager.cc:1397] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.828s user 0.043s sys 0.070s
I20260807 13:38:51.666700 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:51.660331 23533 leader_election.cc:302] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.620090 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:51.661092 23679 raft_consensus.cc:2454] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:51.620630 24732 raft_consensus.cc:2726] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:51.633872 23572 raft_consensus.cc:2454] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4.
I20260807 13:38:51.658227 24738 raft_consensus.cc:2726] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:51.616884 24674 raft_consensus.cc:504] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.673719 23533 leader_election.cc:302] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.674516 23680 raft_consensus.cc:2379] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 3: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:51.662029 24729 raft_consensus.cc:2726] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:38:51.681667 23582 raft_consensus.cc:2379] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 2: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:51.676892 23571 raft_consensus.cc:2454] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:51.662802 24356 consensus_queue.cc:1225] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer 5e0ea5aa0c6d4846a5ccc9962342e17a log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260807 13:38:51.684432 24417 raft_consensus.cc:2726] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:51.675879 24593 raft_consensus.cc:2726] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:38:51.665904 24721 raft_consensus.cc:504] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.689121 24804 leader_election.cc:288] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:51.668497 23671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 368) took 1375 ms. Trace:
I20260807 13:38:51.690212 23633 leader_election.cc:302] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:51.691432 24744 raft_consensus.cc:2781] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:51.691999 24744 raft_consensus.cc:482] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:51.690263 23671 rpcz_store.cc:276] 0807 13:38:50.290549 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:51.547558 (+1257009us) service_pool.cc:227] Handling call
0807 13:38:51.592516 (+ 44958us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:51.658109 (+ 65593us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:51.666250 (+ 8141us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:51.664098 24345 raft_consensus.cc:686] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 5 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:51.692549 24636 leader_election.cc:288] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:51.670481 23470 raft_consensus.cc:2379] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 2: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:51.698966 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:51.699934 23680 raft_consensus.cc:3037] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Advancing to term 5
W20260807 13:38:51.680298 23533 leader_election.cc:341] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:51.701088 23533 leader_election.cc:302] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.702814 23533 leader_election.cc:302] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.703826 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a3da79d3b0447cbc19c4f28279e134" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:51.705613 23533 leader_election.cc:302] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.693540 24345 consensus_queue.cc:237] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.710736 24485 consensus_queue.cc:237] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.711432 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:51.661846 24652 raft_consensus.cc:504] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.718106 23676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 394) took 1537 ms. Trace:
I20260807 13:38:51.713006 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:51.728883 23572 raft_consensus.cc:2396] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:38:51.708662 24738 raft_consensus.cc:2726] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:51.715703 24593 raft_consensus.cc:2726] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:38:51.667809 24647 raft_consensus.cc:2726] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:38:51.727833 23581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 248) took 1832 ms. Trace:
I20260807 13:38:51.720409 23740 tablet_bootstrap.cc:492] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:51.664067 23672 raft_consensus.cc:2454] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:51.778853 23740 ts_tablet_manager.cc:1397] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 0.955s user 0.042s sys 0.028s
I20260807 13:38:51.778978 23581 rpcz_store.cc:276] 0807 13:38:49.895220 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:49.895374 (+ 154us) service_pool.cc:227] Handling call
0807 13:38:50.666424 (+771050us) spinlock_profiling.cc:243] Waited 988 us on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:38:50.666722 (+ 298us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:50.814701 (+147979us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:50.814731 (+ 30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:50.814773 (+ 42us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:50.814801 (+ 28us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:51.727389 (+912588us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5400386654. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:51.727445 (+ 56us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:51.727752 (+ 307us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":342142720}
I20260807 13:38:51.692485 24744 raft_consensus.cc:3037] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:51.709770 24804 raft_consensus.cc:2726] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260807 13:38:51.784905 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 47541.6us
I20260807 13:38:51.786114 23533 leader_election.cc:302] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.689196 24721 leader_election.cc:288] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:51.795399 23533 leader_election.cc:341] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:51.797398 23533 leader_election.cc:302] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.797479 23740 raft_consensus.cc:348] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.798558 23740 raft_consensus.cc:374] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:51.798921 23740 raft_consensus.cc:729] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
W20260807 13:38:51.724535 24774 log.cc:924] Time spent T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 1.424s user 0.008s sys 0.004s
I20260807 13:38:51.800386 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:51.800642 23533 leader_election.cc:302] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
W20260807 13:38:51.793532 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 198971us
I20260807 13:38:51.801506 23581 raft_consensus.cc:2454] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:38:51.802591 23631 leader_election.cc:302] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.803208 23633 leader_election.cc:302] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:51.804461 23631 leader_election.cc:302] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.803123 23740 consensus_queue.cc:260] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:51.805111 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 205764us
I20260807 13:38:51.817533 24607 raft_consensus.cc:2726] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:38:51.817945 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:51.818441 24652 leader_election.cc:288] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:51.732033 24746 leader_election.cc:288] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:51.816874 23631 leader_election.cc:302] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.820072 23737 raft_consensus.cc:348] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.820972 23737 raft_consensus.cc:374] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:51.820966 23631 leader_election.cc:302] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.713465 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:51.730346 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:51.774945 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:51.719383 24806 leader_election.cc:288] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:51.821552 23737 raft_consensus.cc:729] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
W20260807 13:38:51.824071 23533 leader_election.cc:341] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:51.823978 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:51.836974 23533 leader_election.cc:302] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
W20260807 13:38:51.838107 23533 leader_election.cc:341] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:51.838486 23533 leader_election.cc:302] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.838317 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:51.709411 24636 raft_consensus.cc:482] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:51.839548 23581 raft_consensus.cc:3037] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:51.840936 23631 leader_election.cc:302] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.837096 23737 consensus_queue.cc:260] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.792055 23672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57122 (request call id 379) took 1409 ms. Trace:
I20260807 13:38:51.843820 23430 leader_election.cc:302] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:51.708315 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:51.717922 24674 leader_election.cc:288] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:51.816232 24732 raft_consensus.cc:2726] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:38:51.720722 24722 leader_election.cc:288] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:51.815583 24738 raft_consensus.cc:2726] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:38:51.805363 24593 raft_consensus.cc:2726] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:38:51.857784 23430 leader_election.cc:302] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:51.819979 24729 raft_consensus.cc:2726] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:38:51.882305 23430 leader_election.cc:302] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:51.825344 24719 raft_consensus.cc:2726] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:51.856074 23572 raft_consensus.cc:2379] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 2: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:51.843175 24652 raft_consensus.cc:2726] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:38:51.840368 24507 raft_consensus.cc:2726] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:51.889041 23429 leader_election.cc:302] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:51.845320 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:51.844771 24607 raft_consensus.cc:482] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:51.892006 23430 leader_election.cc:341] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:51.861765 24345 raft_consensus.cc:482] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:51.858217 24806 raft_consensus.cc:482] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:51.865481 23574 raft_consensus.cc:2379] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 3: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
W20260807 13:38:51.898429 23429 leader_election.cc:341] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:51.900923 23430 leader_election.cc:302] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:51.845116 24437 raft_consensus.cc:2726] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:51.884038 24721 raft_consensus.cc:2781] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:38:51.843662 23672 rpcz_store.cc:276] 0807 13:38:50.377107 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:50.836614 (+459507us) service_pool.cc:227] Handling call
0807 13:38:51.786428 (+949814us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:51.843144 24740 consensus_queue.cc:1046] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260807 13:38:51.856673 24802 raft_consensus.cc:482] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:51.884670 24789 raft_consensus.cc:2781] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:51.861291 24519 raft_consensus.cc:482] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:51.883910 24722 raft_consensus.cc:3037] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:51.888798 24674 raft_consensus.cc:2726] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:38:51.925112 23577 raft_consensus.cc:2379] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 3: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:51.888440 24485 raft_consensus.cc:2781] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:51.902122 23581 raft_consensus.cc:2454] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:51.847661 24636 raft_consensus.cc:504] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:51.896960 23573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 329) took 1767 ms (client timeout 2036 ms). Trace:
I20260807 13:38:51.943531 23631 leader_election.cc:302] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.901742 24279 raft_consensus.cc:2781] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:51.945021 23469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 240) took 1052 ms. Trace:
I20260807 13:38:51.897991 23677 raft_consensus.cc:2379] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 2: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:51.948539 23633 leader_election.cc:302] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:51.728127 23676 rpcz_store.cc:276] 0807 13:38:50.180347 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:51.186107 (+1005760us) service_pool.cc:227] Handling call
0807 13:38:51.198114 (+ 12007us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:51.198928 (+ 814us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:51.198963 (+ 35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:51.199536 (+ 573us) log.cc:842] Serialized 26 byte log entry
0807 13:38:51.512696 (+313160us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:51.654075 (+141379us) log.cc:842] Serialized 14 byte log entry
0807 13:38:51.663812 (+ 9737us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:51.667390 (+ 3578us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:51.670250 (+ 2860us) raft_consensus.cc:1671] finished
0807 13:38:51.672325 (+ 2075us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:51.707328 (+ 35003us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":748,"prepare.queue_time_us":198438,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":59,"raft.queue_time_us":2514,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":3029,"thread_start_us":431339,"threads_started":2,"wal-append.queue_time_us":389452}
I20260807 13:38:51.948009 24652 raft_consensus.cc:3037] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:51.949761 23471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 408) took 2620 ms. Trace:
I20260807 13:38:51.950381 24356 raft_consensus.cc:482] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:51.952539 24279 raft_consensus.cc:686] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:51.953819 23739 tablet_bootstrap.cc:492] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:51.954267 23475 raft_consensus.cc:1226] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 4 LEADER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4. Ops: []
I20260807 13:38:51.952543 24636 leader_election.cc:288] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:51.943410 24802 raft_consensus.cc:504] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.944480 23574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 268) took 1118 ms. Trace:
I20260807 13:38:51.955559 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 380) took 1154 ms. Trace:
I20260807 13:38:51.937466 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:51.937964 24820 raft_consensus.cc:2726] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:51.955912 24485 raft_consensus.cc:686] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:51.957576 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:51.947093 23631 leader_election.cc:302] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:51.948019 24721 raft_consensus.cc:686] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 4 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:51.958400 23737 ts_tablet_manager.cc:1428] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.291s user 0.017s sys 0.033s
I20260807 13:38:51.932121 24345 raft_consensus.cc:504] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.959475 23478 raft_consensus.cc:3032] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:38:51.960556 23473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 418) took 1600 ms. Trace:
I20260807 13:38:51.963621 23679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 376) took 1632 ms. Trace:
I20260807 13:38:51.967389 23429 leader_election.cc:302] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:51.967792 23740 ts_tablet_manager.cc:1428] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.188s user 0.008s sys 0.005s
I20260807 13:38:51.972385 24746 raft_consensus.cc:482] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:51.981737 23580 rpcz_store.cc:276] 0807 13:38:50.801495 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:50.839621 (+ 38126us) service_pool.cc:227] Handling call
0807 13:38:51.955345 (+1115724us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54004349d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:51.955488 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1304987904}
W20260807 13:38:51.990576 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 43576.6us
I20260807 13:38:51.988315 23581 raft_consensus.cc:3037] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:38:51.945955 23573 rpcz_store.cc:269] 0807 13:38:50.123525 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:50.125960 (+ 2435us) service_pool.cc:227] Handling call
0807 13:38:51.713291 (+1587331us) spinlock_profiling.cc:243] Waited 7.15 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:51.888474 (+175183us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":16444672}
I20260807 13:38:51.902295 24819 raft_consensus.cc:482] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:51.973930 24719 raft_consensus.cc:482] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:51.993777 23631 leader_election.cc:302] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:51.996613 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:51.987910 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:52.001950 23577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 325) took 1904 ms. Trace:
I20260807 13:38:52.002388 23577 rpcz_store.cc:276] 0807 13:38:50.097804 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:50.103211 (+ 5407us) service_pool.cc:227] Handling call
0807 13:38:50.822219 (+719008us) spinlock_profiling.cc:243] Waited 7.41 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:51.817784 (+995565us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ffb7c 00007fc6950ff73b 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:52.001737 (+183953us) spinlock_profiling.cc:243] Waited 65.1 ms on lock 0x7b540020d5d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:52.001885 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":169005952}
I20260807 13:38:52.003717 24789 raft_consensus.cc:482] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:52.004209 24831 raft_consensus.cc:2781] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:52.005024 23671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 371) took 1713 ms. Trace:
I20260807 13:38:52.005323 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39707c5d97164544b9f5c03db41181c0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:52.006361 23737 tablet_bootstrap.cc:492] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:52.005813 24485 consensus_queue.cc:237] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.006712 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:51.972169 23471 rpcz_store.cc:276] 0807 13:38:49.329613 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:49.690444 (+360831us) service_pool.cc:227] Handling call
0807 13:38:49.690914 (+ 470us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:50.133859 (+442945us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:51.949482 (+1815623us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b5400273654. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:51.949693 (+ 211us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":860636544}
I20260807 13:38:51.948946 23469 rpcz_store.cc:276] 0807 13:38:50.892680 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:51.780778 (+888098us) service_pool.cc:227] Handling call
0807 13:38:51.944938 (+164160us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:52.005348 24279 consensus_queue.cc:237] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.009850 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:51.979326 24356 raft_consensus.cc:504] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.981597 23574 rpcz_store.cc:276] 0807 13:38:50.824290 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:51.090632 (+266342us) service_pool.cc:227] Handling call
0807 13:38:51.711243 (+620611us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:51.942401 (+231158us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4462464}
I20260807 13:38:51.997381 24345 leader_election.cc:288] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:51.989696 23679 rpcz_store.cc:276] 0807 13:38:50.330870 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:51.731693 (+1400823us) service_pool.cc:227] Handling call
0807 13:38:51.732121 (+ 428us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:51.732448 (+ 327us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:51.732474 (+ 26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:51.732847 (+ 373us) log.cc:842] Serialized 26 byte log entry
0807 13:38:51.859190 (+126343us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:38:51.859224 (+ 34us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:51.859279 (+ 55us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:51.963344 (+104065us) raft_consensus.cc:1671] finished
0807 13:38:51.963375 (+ 31us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:51.963551 (+ 176us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":88,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":13656,"thread_start_us":77933,"threads_started":1,"wal-append.queue_time_us":175464}
I20260807 13:38:51.990939 24636 raft_consensus.cc:2726] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:38:51.989349 23478 raft_consensus.cc:729] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:52.029417 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:51.944278 24519 raft_consensus.cc:504] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.976866 24830 raft_consensus.cc:2781] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election won for term 2
W20260807 13:38:51.980582 23677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57116 (request call id 375) took 1941 ms (client timeout 1658 ms). Trace:
I20260807 13:38:52.016397 23633 leader_election.cc:302] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:52.034026 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6ae70649fa43bba8052b66977418f5" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:52.051086 23679 raft_consensus.cc:3037] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:51.923388 24607 raft_consensus.cc:504] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.004253 24789 raft_consensus.cc:3037] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:52.049414 24721 consensus_queue.cc:237] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.983227 24578 raft_consensus.cc:504] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.000095 24820 raft_consensus.cc:2781] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:38:52.008980 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:52.048257 23578 raft_consensus.cc:2454] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:52.048528 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a3da79d3b0447cbc19c4f28279e134" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:51.949213 24806 raft_consensus.cc:504] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.040832 24719 raft_consensus.cc:504] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.044099 23631 leader_election.cc:302] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:52.011509 23469 raft_consensus.cc:1226] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:52.012921 24746 raft_consensus.cc:504] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.063993 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:52.050773 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:51.991495 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:52.065034 23581 raft_consensus.cc:2454] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:52.064129 23679 raft_consensus.cc:2454] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:52.005432 23671 rpcz_store.cc:276] 0807 13:38:50.291592 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:51.692801 (+1401209us) service_pool.cc:227] Handling call
0807 13:38:52.004723 (+311922us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54000420a8. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc69cf067f1 00007fc69cf812dc 00007fc69cfb537c 00007fc69cfa080b 00007fc69cfa02a2 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c
0807 13:38:52.004953 (+ 230us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":295830272}
I20260807 13:38:52.012697 24356 leader_election.cc:288] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:52.041440 24732 raft_consensus.cc:482] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:51.998931 24744 raft_consensus.cc:504] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.108204 23581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 387) took 1304 ms. Trace:
I20260807 13:38:52.060812 24747 raft_consensus.cc:3037] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:52.058164 24722 raft_consensus.cc:2726] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:38:52.108748 23581 rpcz_store.cc:276] 0807 13:38:50.803504 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:51.957271 (+1153767us) service_pool.cc:227] Handling call
0807 13:38:52.108133 (+150862us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:52.071200 23631 leader_election.cc:302] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:52.076719 23580 raft_consensus.cc:2454] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:52.113737 23633 leader_election.cc:302] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:52.117318 23680 raft_consensus.cc:2454] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 5.
I20260807 13:38:52.118243 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:52.061196 24830 raft_consensus.cc:686] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:52.110683 23429 leader_election.cc:302] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:52.068624 24738 raft_consensus.cc:482] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:52.126979 23344 rpcz_store.cc:275] Call kudu.master.MasterService.IsCreateTableDone from 127.0.0.1:41396 (request call id 42) took 1107 ms. Trace:
I20260807 13:38:52.110363 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:52.127410 23344 rpcz_store.cc:276] 0807 13:38:51.047861 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:51.060281 (+ 12420us) service_pool.cc:227] Handling call
0807 13:38:51.074619 (+ 14338us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0807 13:38:51.074779 (+ 160us) catalog_manager.cc:2245] Verify if the table creation is in progress for test-workload [id=6c3159b450c749628fd57db2251c593c]
0807 13:38:52.115157 (+1040378us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1039488}
W20260807 13:38:52.112133 24434 consensus_meta.cc:287] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.615s user 0.014s sys 0.000s
I20260807 13:38:52.129165 23679 raft_consensus.cc:2454] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:52.070003 24820 raft_consensus.cc:686] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:52.073263 23578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 273) took 1020 ms. Trace:
I20260807 13:38:52.072458 24636 raft_consensus.cc:2726] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:52.108309 24674 raft_consensus.cc:482] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:52.147217 23429 leader_election.cc:302] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:52.148712 23429 leader_election.cc:302] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:52.116952 24732 raft_consensus.cc:504] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.066759 24819 raft_consensus.cc:504] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:51.991254 23473 rpcz_store.cc:276] 0807 13:38:50.360224 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:50.360404 (+ 180us) service_pool.cc:227] Handling call
0807 13:38:50.360815 (+ 411us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:50.800374 (+439559us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:51.960208 (+1159834us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b54001e32d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:51.960482 (+ 274us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":922497792}
W20260807 13:38:52.144670 23407 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:38:52.151892 23580 raft_consensus.cc:1226] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:52.115324 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:52.123953 24356 raft_consensus.cc:482] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
W20260807 13:38:52.160071 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 46424.8us
W20260807 13:38:52.169684 23681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57116 (request call id 388) took 2102 ms (client timeout 2196 ms). Trace:
I20260807 13:38:52.162665 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 334) took 2006 ms. Trace:
W20260807 13:38:52.057642 23677 rpcz_store.cc:269] 0807 13:38:50.037432 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:50.044376 (+ 6944us) service_pool.cc:227] Handling call
0807 13:38:51.698246 (+1653870us) spinlock_profiling.cc:243] Waited 9.47 ms on lock 0x7b5800004298. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:51.978430 (+280184us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":21782400}
W20260807 13:38:52.170300 23681 rpcz_store.cc:269] 0807 13:38:50.067777 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:50.088601 (+ 20824us) service_pool.cc:227] Handling call
0807 13:38:50.486612 (+398011us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b5800004298. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:52.169437 (+1682825us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b5400030554. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:52.169600 (+ 163us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":518502912}
I20260807 13:38:52.171272 23684 raft_consensus.cc:1261] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:38:52.150092 23577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 399) took 1179 ms. Trace:
I20260807 13:38:52.170539 23580 rpcz_store.cc:276] 0807 13:38:50.156595 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.127620 (+1971025us) service_pool.cc:227] Handling call
0807 13:38:52.151621 (+ 24001us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.159235 (+ 7614us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.162603 (+ 3368us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:52.172022 23681 raft_consensus.cc:1226] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4. Ops: []
W20260807 13:38:52.174275 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 103191us
I20260807 13:38:52.177386 23681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 404) took 1832 ms. Trace:
I20260807 13:38:52.177534 23631 leader_election.cc:302] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters: 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:52.177790 23681 rpcz_store.cc:276] 0807 13:38:50.344756 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.171513 (+1826757us) service_pool.cc:227] Handling call
0807 13:38:52.171851 (+ 338us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.177106 (+ 5255us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.177316 (+ 210us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:52.179425 23681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 381) took 1755 ms. Trace:
I20260807 13:38:52.179723 23681 rpcz_store.cc:276] 0807 13:38:50.424184 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.178636 (+1754452us) service_pool.cc:227] Handling call
0807 13:38:52.178952 (+ 316us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.179151 (+ 199us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:52.179175 (+ 24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:52.179213 (+ 38us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:52.179242 (+ 29us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.179298 (+ 56us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:52.179379 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:52.157518 24636 raft_consensus.cc:2781] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:52.129730 24738 raft_consensus.cc:504] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.146118 24434 raft_consensus.cc:504] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.189504 23681 raft_consensus.cc:1226] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 2. Current term is 3. Ops: []
I20260807 13:38:52.194253 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9fcdd060ef64874a8719c95b2325942" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:52.197127 23681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 384) took 1639 ms. Trace:
I20260807 13:38:52.153563 24674 raft_consensus.cc:504] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.197503 23681 rpcz_store.cc:276] 0807 13:38:50.557291 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.187436 (+1630145us) service_pool.cc:227] Handling call
0807 13:38:52.188678 (+ 1242us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.196844 (+ 8166us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.197065 (+ 221us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:52.180889 23675 raft_consensus.cc:3037] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:52.124761 23478 consensus_queue.cc:260] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:38:52.199179 23681 raft_consensus.cc:1226] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4. Ops: []
I20260807 13:38:52.173787 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faff067df57c4de49e89824bbc248751" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:52.200120 23580 raft_consensus.cc:2379] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 1: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:52.147068 23578 rpcz_store.cc:276] 0807 13:38:51.053941 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:51.661788 (+607847us) service_pool.cc:227] Handling call
0807 13:38:52.048139 (+386351us) spinlock_profiling.cc:243] Waited 4.53 ms on lock 0x7b2c00017738. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc696406301 00007fc6964208ba 00007fc69805881d 00007fc69806456b 00007fc69806325d 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2
0807 13:38:52.070369 (+ 22230us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":10422016}
I20260807 13:38:52.186494 24636 raft_consensus.cc:482] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:52.176527 23577 rpcz_store.cc:276] 0807 13:38:50.966871 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.003423 (+1036552us) service_pool.cc:227] Handling call
0807 13:38:52.145766 (+142343us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:52.204011 23681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 385) took 1543 ms. Trace:
I20260807 13:38:52.205214 23681 rpcz_store.cc:276] 0807 13:38:50.660647 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.198342 (+1537695us) service_pool.cc:227] Handling call
0807 13:38:52.199014 (+ 672us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.201283 (+ 2269us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.203942 (+ 2659us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:52.198583 23573 raft_consensus.cc:2396] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:38:52.173956 24356 raft_consensus.cc:504] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:52.208777 23430 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.69.2:33363 timed out after 5.041s (SENT) [suppressed 31 similar messages]
I20260807 13:38:52.195591 24722 raft_consensus.cc:2781] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:52.191955 24802 leader_election.cc:288] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:52.209553 23631 leader_election.cc:302] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:52.205566 24636 raft_consensus.cc:3037] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:52.225558 23580 raft_consensus.cc:1226] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:38:52.225020 23739 tablet_bootstrap.cc:654] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:52.226612 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 345) took 2066 ms. Trace:
I20260807 13:38:52.227029 23580 rpcz_store.cc:276] 0807 13:38:50.166546 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.208239 (+2041693us) service_pool.cc:227] Handling call
0807 13:38:52.224289 (+ 16050us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:52.226313 (+ 2024us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.226555 (+ 242us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:52.228652 23580 raft_consensus.cc:1226] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:52.202739 24844 raft_consensus.cc:2781] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:52.229192 23680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 377) took 1896 ms. Trace:
I20260807 13:38:52.208039 24519 leader_election.cc:288] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:52.229879 23680 rpcz_store.cc:276] 0807 13:38:50.333162 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.141715 (+1808553us) service_pool.cc:227] Handling call
0807 13:38:52.142083 (+ 368us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.142286 (+ 203us) raft_consensus.cc:1520] Early marking committed up to index 3
0807 13:38:52.155998 (+ 13712us) log.cc:842] Serialized 14 byte log entry
0807 13:38:52.218841 (+ 62843us) log.cc:842] Serialized 14 byte log entry
0807 13:38:52.228847 (+ 10006us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:52.228919 (+ 72us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:38:52.228958 (+ 39us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.229012 (+ 54us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:52.229128 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2201,"prepare.queue_time_us":15315,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":70,"thread_start_us":69459,"threads_started":4}
I20260807 13:38:52.219836 23674 raft_consensus.cc:1226] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4. Ops: []
I20260807 13:38:52.210666 23478 raft_consensus.cc:3037] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:52.211030 23572 raft_consensus.cc:1226] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:52.229192 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 346) took 2040 ms. Trace:
I20260807 13:38:52.236514 23580 rpcz_store.cc:276] 0807 13:38:50.188615 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.227966 (+2039351us) service_pool.cc:227] Handling call
0807 13:38:52.228414 (+ 448us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.229022 (+ 608us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.229141 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:52.210352 24847 raft_consensus.cc:2781] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:52.213302 24578 leader_election.cc:288] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:52.219249 24722 raft_consensus.cc:482] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:52.229367 23573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 360) took 1820 ms. Trace:
I20260807 13:38:52.231777 23473 raft_consensus.cc:1261] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:52.191254 24830 consensus_queue.cc:237] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.233912 24844 raft_consensus.cc:482] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:52.246742 23580 raft_consensus.cc:1226] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:52.235044 24843 raft_consensus.cc:2781] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:38:52.252794 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 348) took 2030 ms. Trace:
I20260807 13:38:52.242877 24722 raft_consensus.cc:3037] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:52.239863 24806 leader_election.cc:288] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:52.239082 24744 leader_election.cc:288] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:52.238932 24719 leader_election.cc:288] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:52.254953 23578 raft_consensus.cc:1226] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4. Ops: []
I20260807 13:38:52.268985 23578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 341) took 2110 ms. Trace:
I20260807 13:38:52.254540 23580 rpcz_store.cc:276] 0807 13:38:50.222153 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.237199 (+2015046us) service_pool.cc:227] Handling call
0807 13:38:52.246571 (+ 9372us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.252544 (+ 5973us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.252738 (+ 194us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:52.239082 24851 raft_consensus.cc:482] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:52.242831 24746 leader_election.cc:288] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:52.208815 24820 consensus_queue.cc:237] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.242990 23573 rpcz_store.cc:276] 0807 13:38:50.405558 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.050272 (+1644714us) service_pool.cc:227] Handling call
0807 13:38:52.225511 (+175239us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:38:52.260165 24837 log.cc:924] Time spent T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.064s user 0.000s sys 0.001s
W20260807 13:38:52.253520 24835 log.cc:924] Time spent T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.120s user 0.000s sys 0.001s
I20260807 13:38:52.253161 24844 raft_consensus.cc:3037] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:52.305121 23480 raft_consensus.cc:1226] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260807 13:38:52.305227 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 430) took 1911 ms. Trace:
I20260807 13:38:52.306524 24819 leader_election.cc:288] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
W20260807 13:38:52.275477 24824 log.cc:924] Time spent T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.326s user 0.004s sys 0.000s
I20260807 13:38:52.305663 23481 rpcz_store.cc:276] 0807 13:38:50.393868 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:50.531781 (+137913us) service_pool.cc:227] Handling call
0807 13:38:50.548250 (+ 16469us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:50.563819 (+ 15569us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:50.563848 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:50.573062 (+ 9214us) log.cc:842] Serialized 26 byte log entry
0807 13:38:51.726041 (+1152979us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b1800303700. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc69dfd68b1 00007fc69dfe3661 00007fc695137799 00007fc69513ab11 00007fc69513aac9 00007fc69513aa59 00007fc69513aa21 00007fc695139d1d 00007fc69e39b204 00007fc69e39b039 00007fc695119dc6
0807 13:38:51.957615 (+231574us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b1800303700. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc69dfd68b1 00007fc69dfe3661 00007fc695119345 00007fc69df50a39 00007fc6951368bb 00007fc695134cbf 00007fc695136e22 00007fc697ce05bb 00007fc697ce6063 00007fc697ce6411 00007fc6980335cf
0807 13:38:51.999284 (+ 41669us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:51.999324 (+ 40us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:51.999396 (+ 72us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:52.304994 (+305598us) raft_consensus.cc:1671] finished
0807 13:38:52.305019 (+ 25us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:52.305162 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":11099,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":10244,"spinlock_wait_cycles":277898368,"thread_start_us":41448,"threads_started":1,"wal-append.queue_time_us":1524741}
W20260807 13:38:52.276018 24838 log.cc:924] Time spent T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.094s user 0.001s sys 0.001s
I20260807 13:38:52.306178 23675 raft_consensus.cc:2454] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:52.309078 24356 leader_election.cc:288] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:52.277588 23671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 410) took 1065 ms. Trace:
I20260807 13:38:52.280674 24806 raft_consensus.cc:482] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:52.309653 23671 rpcz_store.cc:276] 0807 13:38:51.212375 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.229552 (+1017177us) service_pool.cc:227] Handling call
0807 13:38:52.254846 (+ 25294us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.270343 (+ 15497us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:52.277186 (+ 6843us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:52.277244 (+ 58us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:38:52.277288 (+ 44us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.277364 (+ 76us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:52.277522 (+ 158us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:52.309967 24806 raft_consensus.cc:504] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.312502 24434 leader_election.cc:288] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:52.312947 24806 leader_election.cc:288] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:52.249641 24847 raft_consensus.cc:686] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:52.250407 24850 raft_consensus.cc:2781] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:52.288445 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:52.313800 24850 raft_consensus.cc:482] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:52.314013 23580 raft_consensus.cc:3037] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:52.314265 24850 raft_consensus.cc:3037] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:52.293236 24519 raft_consensus.cc:482] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:52.293689 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:52.269392 23578 rpcz_store.cc:276] 0807 13:38:50.158628 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.208478 (+2049850us) service_pool.cc:227] Handling call
0807 13:38:52.241803 (+ 33325us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.268654 (+ 26851us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.268914 (+ 260us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:52.290449 24851 raft_consensus.cc:504] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.302641 23737 tablet_bootstrap.cc:654] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:52.307893 24674 leader_election.cc:288] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:52.252170 23572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 336) took 2095 ms. Trace:
W20260807 13:38:52.292977 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 144293us
I20260807 13:38:52.303927 24747 raft_consensus.cc:2726] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:38:52.328197 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 95050.9us
I20260807 13:38:52.314283 24847 consensus_queue.cc:237] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.332086 23573 raft_consensus.cc:2454] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:52.315466 24519 raft_consensus.cc:504] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.332855 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:52.349224 23631 leader_election.cc:302] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:52.354701 23580 raft_consensus.cc:2454] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:38:52.358448 23633 leader_election.cc:302] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:52.359217 23631 leader_election.cc:302] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:52.360149 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:52.363286 23580 raft_consensus.cc:3037] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:52.320425 24857 raft_consensus.cc:2726] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:38:52.334409 24652 raft_consensus.cc:2726] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:52.368165 23633 leader_election.cc:302] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:52.340822 24752 raft_consensus.cc:482] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:52.371567 23679 raft_consensus.cc:1226] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:52.363305 24719 raft_consensus.cc:3037] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:52.365736 24744 raft_consensus.cc:2781] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:52.333247 24722 raft_consensus.cc:504] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.376155 23680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 413) took 1162 ms. Trace:
I20260807 13:38:52.371409 23677 raft_consensus.cc:1226] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 2. Current term is 3. Ops: []
I20260807 13:38:52.381028 23680 rpcz_store.cc:276] 0807 13:38:51.213380 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.233585 (+1020205us) service_pool.cc:227] Handling call
0807 13:38:52.234022 (+ 437us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.375752 (+141730us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:52.375787 (+ 35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:52.375831 (+ 44us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:52.375860 (+ 29us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.375979 (+ 119us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:52.376102 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1041,"raft.queue_time_us":33329,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":10738,"thread_start_us":136244,"threads_started":1}
I20260807 13:38:52.373629 24752 raft_consensus.cc:3037] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:52.383493 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:52.383981 23580 raft_consensus.cc:2454] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4.
I20260807 13:38:52.340605 23572 rpcz_store.cc:276] 0807 13:38:50.157206 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.169109 (+2011903us) service_pool.cc:227] Handling call
0807 13:38:52.198760 (+ 29651us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.239597 (+ 40837us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.249186 (+ 9589us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:52.385164 23739 tablet_bootstrap.cc:492] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:52.385655 23680 raft_consensus.cc:2454] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:52.386198 23739 ts_tablet_manager.cc:1397] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.433s user 0.006s sys 0.014s
I20260807 13:38:52.387513 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:52.388033 23580 raft_consensus.cc:1261] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:38:52.388682 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 350) took 2058 ms. Trace:
I20260807 13:38:52.388972 23580 rpcz_store.cc:276] 0807 13:38:50.329904 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.387442 (+2057538us) service_pool.cc:227] Handling call
0807 13:38:52.387762 (+ 320us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.388433 (+ 671us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.388627 (+ 194us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:52.378281 24819 raft_consensus.cc:2726] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:52.390632 23572 raft_consensus.cc:1261] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:52.391417 23572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 261) took 1685 ms. Trace:
I20260807 13:38:52.391790 23572 rpcz_store.cc:276] 0807 13:38:50.705607 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.389898 (+1684291us) service_pool.cc:227] Handling call
0807 13:38:52.390247 (+ 349us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.391091 (+ 844us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.391345 (+ 254us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:52.388417 23680 raft_consensus.cc:2454] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:52.387075 23633 leader_election.cc:302] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:52.394129 23580 raft_consensus.cc:1226] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:52.394690 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:52.378352 23671 raft_consensus.cc:1226] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:52.389649 24869 raft_consensus.cc:2781] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:52.396881 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:52.398201 24851 leader_election.cc:288] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:52.400121 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 359) took 1989 ms. Trace:
I20260807 13:38:52.401690 23580 rpcz_store.cc:276] 0807 13:38:50.405214 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.389613 (+1984399us) service_pool.cc:227] Handling call
0807 13:38:52.393944 (+ 4331us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.394648 (+ 704us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.394834 (+ 186us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:52.403416 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 263) took 1668 ms. Trace:
I20260807 13:38:52.404488 23580 rpcz_store.cc:276] 0807 13:38:50.735284 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.402582 (+1667298us) service_pool.cc:227] Handling call
0807 13:38:52.402868 (+ 286us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.403006 (+ 138us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:52.403021 (+ 15us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:52.403047 (+ 26us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:52.403104 (+ 57us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.403239 (+ 135us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:52.403353 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:52.373399 24747 consensus_queue.cc:1035] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260807 13:38:52.400723 24869 raft_consensus.cc:482] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:52.383003 24744 raft_consensus.cc:686] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:52.436510 24869 raft_consensus.cc:3037] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:52.378719 24652 consensus_queue.cc:1046] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260807 13:38:52.463760 23680 raft_consensus.cc:1261] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:52.465857 23580 raft_consensus.cc:1261] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:38:52.466535 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 265) took 1694 ms. Trace:
I20260807 13:38:52.466840 23580 rpcz_store.cc:276] 0807 13:38:50.772270 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.406197 (+1633927us) service_pool.cc:227] Handling call
0807 13:38:52.465448 (+ 59251us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.466264 (+ 816us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.466482 (+ 218us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:52.476468 23680 raft_consensus.cc:1226] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 4. Current term is 5. Ops: []
I20260807 13:38:52.485174 23680 raft_consensus.cc:1261] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:52.490670 23680 raft_consensus.cc:1226] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:52.493947 23580 raft_consensus.cc:1261] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 1. (index mismatch)
I20260807 13:38:52.494679 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 373) took 1698 ms. Trace:
I20260807 13:38:52.495163 23580 rpcz_store.cc:276] 0807 13:38:50.796564 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.467481 (+1670917us) service_pool.cc:227] Handling call
0807 13:38:52.493561 (+ 26080us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.494377 (+ 816us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.494598 (+ 221us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:52.499702 23680 raft_consensus.cc:1261] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:52.478816 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:52.514078 23680 raft_consensus.cc:1226] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4. Ops: []
I20260807 13:38:52.479177 24844 raft_consensus.cc:504] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.531121 23580 raft_consensus.cc:1226] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4. Ops: []
I20260807 13:38:52.533017 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 374) took 1736 ms. Trace:
I20260807 13:38:52.533430 23580 rpcz_store.cc:276] 0807 13:38:50.796866 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.500384 (+1703518us) service_pool.cc:227] Handling call
0807 13:38:52.530846 (+ 30462us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.532690 (+ 1844us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.532936 (+ 246us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:52.528551 24840 raft_consensus.cc:482] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:52.541461 23580 raft_consensus.cc:1226] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 13:38:52.542409 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 383) took 1740 ms. Trace:
I20260807 13:38:52.542838 23580 rpcz_store.cc:276] 0807 13:38:50.802354 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.540655 (+1738301us) service_pool.cc:227] Handling call
0807 13:38:52.541158 (+ 503us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:52.542048 (+ 890us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.542336 (+ 288us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:52.539113 24840 raft_consensus.cc:504] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.513890 24740 raft_consensus.cc:482] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:52.487977 24873 raft_consensus.cc:2781] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:38:52.496105 24434 consensus_queue.cc:1035] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260807 13:38:52.527545 24320 raft_consensus.cc:482] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:52.539846 24747 raft_consensus.cc:482] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:52.550657 23472 raft_consensus.cc:2379] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 2: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:52.570349 24840 leader_election.cc:288] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:52.552477 24519 leader_election.cc:288] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:52.557914 24859 log.cc:924] Time spent T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.187s user 0.001s sys 0.000s
I20260807 13:38:52.589989 23580 raft_consensus.cc:1226] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4. Ops: []
I20260807 13:38:52.553170 24873 raft_consensus.cc:686] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
W20260807 13:38:52.585764 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 70406.3us
I20260807 13:38:52.554759 23572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 262) took 1845 ms. Trace:
I20260807 13:38:52.594135 23572 rpcz_store.cc:276] 0807 13:38:50.708702 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.402160 (+1693458us) service_pool.cc:227] Handling call
0807 13:38:52.493937 (+ 91777us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.526044 (+ 32107us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:52.530768 (+ 4724us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:52.537218 (+ 6450us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:52.539532 (+ 2314us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.548890 (+ 9358us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:52.553640 (+ 4750us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:52.597060 24652 raft_consensus.cc:3032] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:38:52.598672 23532 leader_election.cc:302] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:52.555312 24320 raft_consensus.cc:504] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:52.602111 24872 log.cc:924] Time spent T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.185s user 0.000s sys 0.001s
W20260807 13:38:52.603971 24867 log.cc:924] Time spent T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.126s user 0.000s sys 0.001s
W20260807 13:38:52.604509 24858 log.cc:924] Time spent T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.209s user 0.000s sys 0.001s
I20260807 13:38:52.604305 24873 consensus_queue.cc:237] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.606235 24844 leader_election.cc:288] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:52.606873 24844 raft_consensus.cc:482] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:52.607410 24844 raft_consensus.cc:504] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.610911 24844 leader_election.cc:288] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:52.613193 23572 raft_consensus.cc:1226] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:38:52.614727 23572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 386) took 1811 ms. Trace:
I20260807 13:38:52.616150 24320 leader_election.cc:288] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:52.615345 23572 rpcz_store.cc:276] 0807 13:38:50.803244 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.612183 (+1808939us) service_pool.cc:227] Handling call
0807 13:38:52.612756 (+ 573us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:52.613980 (+ 1224us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.614650 (+ 670us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:52.620296 23532 leader_election.cc:302] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:52.549137 24740 raft_consensus.cc:504] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:38:52.626024 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 385) took 1788 ms. Trace:
I20260807 13:38:52.626619 23580 rpcz_store.cc:276] 0807 13:38:50.802961 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.589238 (+1786277us) service_pool.cc:227] Handling call
0807 13:38:52.589733 (+ 495us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.591341 (+ 1608us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.591619 (+ 278us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:38:52.623548 23532 leader_election.cc:341] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:52.546000 24744 consensus_queue.cc:237] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.589526 23472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 246) took 1346 ms. Trace:
I20260807 13:38:52.588976 24722 leader_election.cc:288] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
W20260807 13:38:52.685773 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 62278.5us
I20260807 13:38:52.707010 23580 raft_consensus.cc:3032] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:52.597644 24652 raft_consensus.cc:729] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:52.619632 24607 leader_election.cc:288] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:52.621745 24840 raft_consensus.cc:2726] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:52.569406 24747 raft_consensus.cc:504] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.714854 23580 raft_consensus.cc:729] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:52.632166 24320 raft_consensus.cc:2726] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:52.731386 23478 raft_consensus.cc:1261] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:38:52.732290 23478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 247) took 1491 ms. Trace:
I20260807 13:38:52.732543 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:52.732682 23478 rpcz_store.cc:276] 0807 13:38:51.240853 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:51.649169 (+408316us) service_pool.cc:227] Handling call
0807 13:38:51.665491 (+ 16322us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:51.959383 (+293892us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b5400238d20. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc697fef730 00007fc698061300 00007fc698062371 00007fc69805eedf 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc
0807 13:38:52.731953 (+772570us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.732219 (+ 266us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":48123776}
I20260807 13:38:52.733635 23676 raft_consensus.cc:2354] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 2. Current term is 3.
I20260807 13:38:52.735344 24740 leader_election.cc:288] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765), e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037)
I20260807 13:38:52.725167 23580 consensus_queue.cc:260] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:52.717836 24802 consensus_queue.cc:1046] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.222s
W20260807 13:38:52.964944 23681 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.718s user 0.012s sys 0.045s
W20260807 13:38:52.941840 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 227421us
I20260807 13:38:53.094012 23580 raft_consensus.cc:3037] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:38:52.825965 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 426419us
I20260807 13:38:53.096791 23739 raft_consensus.cc:348] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.100009 23739 raft_consensus.cc:374] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:53.102342 23739 raft_consensus.cc:729] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
W20260807 13:38:52.739866 24762 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260807 13:38:52.884152 24674 raft_consensus.cc:482] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:52.740139 24320 consensus_queue.cc:1046] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.364s
I20260807 13:38:52.736995 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
W20260807 13:38:53.098366 24840 consensus_queue.cc:1159] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e11cad1eeaf5424c94e51241096f6613" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260807 13:38:53.098542 24738 leader_election.cc:288] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:52.745730 24652 consensus_queue.cc:260] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:52.743223 24789 consensus_meta.cc:287] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.674s user 0.005s sys 0.008s
I20260807 13:38:53.121241 23739 consensus_queue.cc:260] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:52.740222 24636 consensus_meta.cc:287] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.509s user 0.009s sys 0.003s
I20260807 13:38:52.739420 24747 leader_election.cc:288] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
W20260807 13:38:53.091154 24752 consensus_meta.cc:287] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.691s user 0.006s sys 0.006s
I20260807 13:38:52.745644 23475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 443) took 1341 ms. Trace:
I20260807 13:38:53.103811 24356 raft_consensus.cc:482] T 608f7e63bc4648e0890e5f601c52736c P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:53.105414 24721 consensus_queue.cc:1046] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260807 13:38:53.108497 24879 log.cc:924] Time spent T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.140s user 0.000s sys 0.001s
I20260807 13:38:53.108690 24485 raft_consensus.cc:482] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:53.105610 23572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 389) took 2237 ms. Trace:
W20260807 13:38:53.094060 23681 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.847s user 0.015s sys 0.052s
I20260807 13:38:53.050359 24578 raft_consensus.cc:482] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:53.158385 23681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 388) took 2308 ms. Trace:
W20260807 13:38:53.107187 24869 consensus_meta.cc:287] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.670s user 0.014s sys 0.000s
I20260807 13:38:53.112383 24844 consensus_queue.cc:1035] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:52.712530 23472 rpcz_store.cc:276] 0807 13:38:51.240569 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:51.270972 (+ 30403us) service_pool.cc:227] Handling call
0807 13:38:52.476022 (+1205050us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b5800003398. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:52.587257 (+111235us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8611712}
W20260807 13:38:53.118686 24880 log.cc:924] Time spent T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.151s user 0.001s sys 0.000s
W20260807 13:38:53.118993 23737 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.536s user 0.044s sys 0.066s
I20260807 13:38:52.717396 24719 raft_consensus.cc:2726] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:38:53.167376 23737 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.584s user 0.044s sys 0.067s
I20260807 13:38:53.017199 23740 tablet_bootstrap.cc:492] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
W20260807 13:38:52.735471 23575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 356) took 2331 ms (client timeout 2129 ms). Trace:
W20260807 13:38:53.167835 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 116020us
I20260807 13:38:52.745246 24843 raft_consensus.cc:686] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [term 5 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:53.155331 23739 ts_tablet_manager.cc:1428] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.769s user 0.008s sys 0.004s
I20260807 13:38:53.051589 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:52.748216 24850 raft_consensus.cc:504] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.158806 23681 rpcz_store.cc:276] 0807 13:38:50.850401 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.206198 (+1355797us) service_pool.cc:227] Handling call
0807 13:38:52.206522 (+ 324us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.206671 (+ 149us) raft_consensus.cc:1520] Early marking committed up to index 1
0807 13:38:52.206949 (+ 278us) log.cc:842] Serialized 14 byte log entry
0807 13:38:53.158014 (+951065us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:53.158074 (+ 60us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:53.158114 (+ 40us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:53.158181 (+ 67us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:53.158319 (+ 138us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":115,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":28892,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"thread_start_us":950696,"threads_started":2,"wal-append.queue_time_us":71020}
I20260807 13:38:53.148197 23582 raft_consensus.cc:3037] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:53.169950 23429 leader_election.cc:302] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
W20260807 13:38:53.168807 23739 ts_tablet_manager.cc:1460] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P e11cad1eeaf5424c94e51241096f6613: Tablet startup took 782ms
I20260807 13:38:53.150698 23578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 257) took 2849 ms. Trace:
W20260807 13:38:53.178308 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 80486.3us
W20260807 13:38:53.186672 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 324712us
I20260807 13:38:53.152796 24789 raft_consensus.cc:504] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.153097 24674 raft_consensus.cc:504] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.154196 24636 raft_consensus.cc:504] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.192109 23429 leader_election.cc:302] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:53.196601 23674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 364) took 2922 ms. Trace:
I20260807 13:38:53.179252 24863 raft_consensus.cc:3032] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Stepping down as leader of term 2
W20260807 13:38:53.181233 24873 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s user 0.006s sys 0.015s
I20260807 13:38:53.166458 24578 raft_consensus.cc:504] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.201610 24747 raft_consensus.cc:482] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
W20260807 13:38:53.211416 24873 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s user 0.006s sys 0.015s
I20260807 13:38:53.211750 24747 raft_consensus.cc:504] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.202617 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:53.160436 24356 raft_consensus.cc:504] T 608f7e63bc4648e0890e5f601c52736c P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.210004 24732 leader_election.cc:288] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:53.203590 23674 rpcz_store.cc:276] 0807 13:38:50.274552 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:51.467749 (+1193197us) service_pool.cc:227] Handling call
0807 13:38:51.514217 (+ 46468us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.239130 (+724913us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:53.196297 (+957167us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b54001bdad4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:53.196528 (+ 231us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1583456512}
I20260807 13:38:53.213114 23574 raft_consensus.cc:2362] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2. Re-sending same reply.
I20260807 13:38:53.214814 23574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 372) took 2440 ms. Trace:
I20260807 13:38:53.215288 23574 rpcz_store.cc:276] 0807 13:38:50.796107 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.012829 (+1216722us) service_pool.cc:227] Handling call
0807 13:38:53.202413 (+1189584us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:53.214728 (+ 12315us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":29628160}
I20260807 13:38:53.216966 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:53.219426 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:53.180888 23578 rpcz_store.cc:276] 0807 13:38:50.301074 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.377126 (+2076052us) service_pool.cc:227] Handling call
0807 13:38:52.377554 (+ 428us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.377790 (+ 236us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:38:52.478629 (+100839us) log.cc:842] Serialized 14 byte log entry
0807 13:38:53.034107 (+555478us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:53.059753 (+ 25646us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:53.135028 (+ 75275us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:53.150313 (+ 15285us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:53.150589 (+ 276us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7205,"prepare.queue_time_us":218872,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":51,"raft.queue_time_us":54501,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":23875,"thread_start_us":511603,"threads_started":2,"wal-append.queue_time_us":637424}
I20260807 13:38:53.181418 24898 raft_consensus.cc:3032] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:38:53.211283 24863 raft_consensus.cc:729] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:53.225776 24905 raft_consensus.cc:482] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:53.219525 23346 catalog_manager.cc:5495] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 4 to 5, leader changed from 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3) to 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2). New cstate: current_term: 5 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:53.245257 24903 raft_consensus.cc:2781] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:53.156437 24752 raft_consensus.cc:504] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:53.179798 23739 ts_tablet_manager.cc:1462] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P e11cad1eeaf5424c94e51241096f6613: Trace:
0807 13:38:28.304092 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:28.505711 (+201619us) service_pool.cc:227] Handling call
0807 13:38:28.533016 (+ 27305us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:38:28.533240 (+ 224us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:38:28.642868 (+109628us) tablet_metadata.cc:641] Metadata flushed
0807 13:38:28.657568 (+ 14700us) tablet_replica.cc:205] Creating consensus instance
0807 13:38:28.658108 (+ 540us) inbound_call.cc:173] Queueing success response
0807 13:38:51.953350 (+23295242us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0807 13:38:52.386678 (+433328us) ts_tablet_manager.cc:1429] Starting tablet replica
0807 13:38:52.544768 (+158090us) tablet_replica.cc:259] Starting instrumentation
0807 13:38:52.545326 (+ 558us) tablet_replica.cc:278] Starting consensus
Metrics: {"mutex_wait_us":464796,"raft.queue_time_us":1848,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":3335,"tablet-open.queue_time_us":23295368}
I20260807 13:38:53.162257 24485 raft_consensus.cc:504] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.245113 23737 tablet_bootstrap.cc:492] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:53.261054 23737 ts_tablet_manager.cc:1397] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 1.255s user 0.056s sys 0.071s
W20260807 13:38:53.244364 24823 log.cc:924] Time spent T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 1.264s user 0.004s sys 0.011s
I20260807 13:38:53.245713 23680 raft_consensus.cc:1226] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4. Ops: []
I20260807 13:38:53.199499 23571 raft_consensus.cc:2354] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4.
I20260807 13:38:53.226554 24843 consensus_queue.cc:237] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.166237 24869 raft_consensus.cc:504] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.173099 24721 consensus_queue.cc:1046] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260807 13:38:53.226739 23573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 255) took 2972 ms. Trace:
W20260807 13:38:53.253196 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 60601.4us
I20260807 13:38:53.254519 23346 catalog_manager.cc:5495] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 1 to 2, leader changed from e11cad1eeaf5424c94e51241096f6613 (127.21.69.1) to 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2). New cstate: current_term: 2 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
W20260807 13:38:53.253846 24879 log.cc:924] Time spent T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.050s user 0.000s sys 0.001s
I20260807 13:38:53.264988 24805 raft_consensus.cc:482] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:53.169845 23575 rpcz_store.cc:269] 0807 13:38:50.404191 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:50.761595 (+357404us) service_pool.cc:227] Handling call
0807 13:38:52.720249 (+1958654us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b5400378554. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:52.735372 (+ 15123us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1590407040}
I20260807 13:38:53.267494 23346 catalog_manager.cc:5495] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 1 to 3, leader changed from 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3) to e11cad1eeaf5424c94e51241096f6613 (127.21.69.1). New cstate: current_term: 3 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } }
I20260807 13:38:53.266052 24747 leader_election.cc:288] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:53.248821 24898 raft_consensus.cc:729] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:53.272184 23346 catalog_manager.cc:5495] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 1 to 3, leader changed from 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3) to e11cad1eeaf5424c94e51241096f6613 (127.21.69.1). New cstate: current_term: 3 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } }
I20260807 13:38:53.287326 23739 tablet_bootstrap.cc:492] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:53.256896 24903 raft_consensus.cc:482] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:53.292023 23346 catalog_manager.cc:5495] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2). New cstate: current_term: 1 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:53.309582 23346 catalog_manager.cc:5495] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 2 to 3, leader changed from 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3) to 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2). New cstate: current_term: 3 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:53.311825 24752 leader_election.cc:288] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:53.312583 23346 catalog_manager.cc:5495] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 0 to 2, leader changed from <none> to e11cad1eeaf5424c94e51241096f6613 (127.21.69.1). New cstate: current_term: 2 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } }
I20260807 13:38:53.314850 23346 catalog_manager.cc:5495] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: HEALTHY } } }
I20260807 13:38:53.318814 23346 catalog_manager.cc:5495] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:53.321467 24674 leader_election.cc:288] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:53.320953 23346 catalog_manager.cc:5495] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 0 to 2, leader changed from <none> to 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2). New cstate: current_term: 2 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: HEALTHY } } }
I20260807 13:38:53.322149 24674 raft_consensus.cc:2781] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:53.322525 24674 raft_consensus.cc:482] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:53.322752 24789 leader_election.cc:288] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:53.322916 24674 raft_consensus.cc:3037] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:53.323837 24908 raft_consensus.cc:482] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:53.324036 23479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 257) took 2080 ms. Trace:
I20260807 13:38:53.324159 24636 leader_election.cc:288] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:53.260686 24905 raft_consensus.cc:504] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:53.265048 23571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 398) took 2298 ms (client timeout 2902 ms). Trace:
I20260807 13:38:53.323051 23346 catalog_manager.cc:5495] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:53.377352 23737 raft_consensus.cc:348] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.154175 23475 rpcz_store.cc:276] 0807 13:38:51.404282 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.012118 (+607836us) service_pool.cc:227] Handling call
0807 13:38:52.012437 (+ 319us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.012666 (+ 229us) raft_consensus.cc:1520] Early marking committed up to index 3
0807 13:38:52.013056 (+ 390us) log.cc:842] Serialized 14 byte log entry
0807 13:38:52.241131 (+228075us) log.cc:842] Serialized 14 byte log entry
0807 13:38:52.736065 (+494934us) spinlock_profiling.cc:243] Waited 5.43 ms on lock 0x7b1800337c00. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc69dfd68b1 00007fc69dfe3661 00007fc695137638 00007fc69513ab11 00007fc69513aac9 00007fc69513aa59 00007fc69513aa21 00007fc695139d1d 00007fc69e39b204 00007fc69e39b039 00007fc695119dc6
0807 13:38:52.744898 (+ 8833us) spinlock_profiling.cc:243] Waited 5.21 ms on lock 0x7b1800337c00. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc69dfd68b1 00007fc69dfe3661 00007fc6950ae4ca 00007fc69e78ff99 00007fc694f72990 00007fc695134864 00007fc695134155 00007fc6980573d0 00007fc698069576 00007fc69807a0d7 00007fc69807a058
0807 13:38:52.745094 (+ 196us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:52.745156 (+ 62us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:38:52.745202 (+ 46us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.745301 (+ 99us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:52.745493 (+ 192us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":297489,"prepare.queue_time_us":33127,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":88,"raft.queue_time_us":583696,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":170,"spinlock_wait_cycles":26098432,"thread_start_us":177923,"threads_started":2,"wal-append.queue_time_us":162430}
I20260807 13:38:53.521353 23581 raft_consensus.cc:1226] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:53.497599 23737 raft_consensus.cc:374] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:53.324441 23479 rpcz_store.cc:276] 0807 13:38:51.243527 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:51.667183 (+423656us) service_pool.cc:227] Handling call
0807 13:38:51.695133 (+ 27950us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:51.695510 (+ 377us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:51.695542 (+ 32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:51.696018 (+ 476us) log.cc:842] Serialized 26 byte log entry
0807 13:38:51.852368 (+156350us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:51.991197 (+138829us) log.cc:842] Serialized 14 byte log entry
0807 13:38:51.992249 (+ 1052us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:51.992324 (+ 75us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:53.227130 (+1234806us) spinlock_profiling.cc:243] Waited 65.7 ms on lock 0x7b44000232cc. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc695049a95 00007fc69504a4b2 00007fc697cf2511 00007fc697cede1a 00007fc697ce1bee 00007fc697ce0f36 00007fc697ce0b58 00007fc697cea551 00007fc697cea509 00007fc697cea499
0807 13:38:53.323709 (+ 96579us) raft_consensus.cc:1671] finished
0807 13:38:53.323830 (+ 121us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:53.323972 (+ 142us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":794,"prepare.queue_time_us":106482,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":7964,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":32207,"spinlock_wait_cycles":151106816,"thread_start_us":221334,"threads_started":2,"wal-append.queue_time_us":177873}
I20260807 13:38:53.498090 23346 catalog_manager.cc:5495] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:38:53.480196 23740 tablet_bootstrap.cc:654] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:53.465637 24356 leader_election.cc:288] T 608f7e63bc4648e0890e5f601c52736c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:53.500770 23679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 378) took 3157 ms. Trace:
I20260807 13:38:53.513202 23469 raft_consensus.cc:1226] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:53.527462 23679 rpcz_store.cc:276] 0807 13:38:50.343552 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.146129 (+1802577us) service_pool.cc:227] Handling call
0807 13:38:52.146574 (+ 445us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.372072 (+225498us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:53.500390 (+1128318us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b5400055854. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:53.500681 (+ 291us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":516976000}
I20260807 13:38:53.528486 23581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 333) took 3372 ms. Trace:
I20260807 13:38:53.529150 23739 tablet_bootstrap.cc:654] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
W20260807 13:38:53.513731 23470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 266) took 2001 ms (client timeout 1662 ms). Trace:
I20260807 13:38:53.514178 24893 raft_consensus.cc:3032] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:38:53.379750 23676 raft_consensus.cc:1226] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:53.515712 23677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 383) took 2982 ms. Trace:
I20260807 13:38:53.157749 23572 rpcz_store.cc:276] 0807 13:38:50.868397 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.617981 (+1749584us) service_pool.cc:227] Handling call
0807 13:38:52.618480 (+ 499us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.618774 (+ 294us) raft_consensus.cc:1520] Early marking committed up to index 1
0807 13:38:52.619219 (+ 445us) log.cc:842] Serialized 14 byte log entry
0807 13:38:53.069791 (+450572us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:53.072042 (+ 2251us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:53.075263 (+ 3221us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:53.097954 (+ 22691us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:53.105529 (+ 7575us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8035,"prepare.queue_time_us":633,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":160598,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":27777,"spinlock_wait_cycles":923520,"thread_start_us":410537,"threads_started":2,"wal-append.queue_time_us":425345}
I20260807 13:38:53.522728 23737 raft_consensus.cc:729] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:53.529531 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:53.531867 23679 raft_consensus.cc:2454] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:53.533829 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:53.535882 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:53.543546 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:53.529026 23581 rpcz_store.cc:276] 0807 13:38:50.156208 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.112341 (+1956133us) service_pool.cc:227] Handling call
0807 13:38:53.520843 (+1408502us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:38:53.521124 (+ 281us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:53.528136 (+ 7012us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:53.528406 (+ 270us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6397696}
I20260807 13:38:53.551012 23737 consensus_queue.cc:260] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.549669 24893 raft_consensus.cc:729] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:53.553920 24762 raft_consensus.cc:482] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:53.550309 23677 rpcz_store.cc:276] 0807 13:38:50.533063 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.188219 (+1655156us) service_pool.cc:227] Handling call
0807 13:38:52.220580 (+ 32361us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.396054 (+175474us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:53.515352 (+1119298us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54002c9cd4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:53.515611 (+ 259us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":323665792}
W20260807 13:38:53.550158 23470 rpcz_store.cc:269] 0807 13:38:51.512715 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:51.524731 (+ 12016us) service_pool.cc:227] Handling call
0807 13:38:53.512792 (+1988061us) spinlock_profiling.cc:243] Waited 44.6 ms on lock 0x7b54001e1ed4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:53.513639 (+ 847us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":102553984}
W20260807 13:38:53.511279 23407 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:38:53.557603 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a3da79d3b0447cbc19c4f28279e134" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:53.377458 23674 raft_consensus.cc:1226] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4. Ops: []
W20260807 13:38:53.524469 23533 connection.cc:232] RPC call timeout handler was delayed by -1.2959592351689935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21960000000000002s for a response
I20260807 13:38:53.558691 23679 raft_consensus.cc:2454] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
I20260807 13:38:53.378598 24578 leader_election.cc:288] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:53.484952 24485 leader_election.cc:288] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:53.378084 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:53.325305 23471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 444) took 1920 ms. Trace:
I20260807 13:38:53.327488 24903 raft_consensus.cc:3037] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:53.564466 23737 ts_tablet_manager.cc:1428] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.303s user 0.012s sys 0.003s
I20260807 13:38:53.384268 24869 leader_election.cc:288] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:53.571513 23581 raft_consensus.cc:2454] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:38:53.574824 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:53.561877 24847 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.749s user 0.030s sys 0.033s
I20260807 13:38:53.577266 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6ae70649fa43bba8052b66977418f5" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:53.596035 23679 raft_consensus.cc:2454] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:53.596982 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:53.597608 23581 raft_consensus.cc:2454] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:38:53.598407 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:53.577504 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:53.522426 23571 rpcz_store.cc:269] 0807 13:38:50.966524 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:51.682543 (+716019us) service_pool.cc:227] Handling call
0807 13:38:52.981672 (+1299129us) spinlock_profiling.cc:243] Waited 51.8 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:53.264969 (+283297us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":119037312}
I20260807 13:38:53.577806 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:53.573414 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:53.578300 24578 raft_consensus.cc:482] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
W20260807 13:38:53.585711 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 394146us
I20260807 13:38:53.289716 24805 raft_consensus.cc:504] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.604143 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:53.621112 23679 raft_consensus.cc:2354] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4.
I20260807 13:38:53.635298 23674 raft_consensus.cc:2354] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 2. Current term is 3.
I20260807 13:38:53.614778 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:53.616755 23737 tablet_bootstrap.cc:492] T 356c6b3e51454d418acaa9be70bb9689 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:53.570520 24762 raft_consensus.cc:504] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:53.591713 24847 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.779s user 0.030s sys 0.033s
I20260807 13:38:53.378093 24898 consensus_queue.cc:260] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.630667 24578 raft_consensus.cc:504] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.665616 23676 raft_consensus.cc:2379] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 1: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:53.669498 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:53.324529 24908 raft_consensus.cc:504] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:53.671792 24896 log.cc:924] Time spent T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.568s user 0.007s sys 0.001s
I20260807 13:38:53.672767 24578 leader_election.cc:288] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:53.674134 24578 consensus_queue.cc:1046] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:53.674407 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:53.675747 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:53.676414 23581 raft_consensus.cc:3037] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:53.373816 24863 consensus_queue.cc:260] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.635354 24356 consensus_queue.cc:1035] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260807 13:38:53.657064 24869 raft_consensus.cc:482] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:53.675287 24578 consensus_queue.cc:1046] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260807 13:38:53.636415 23572 raft_consensus.cc:2454] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:53.701333 24417 raft_consensus.cc:482] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:53.703243 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:53.706017 23582 consensus_meta.cc:287] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.516s user 0.011s sys 0.000s
W20260807 13:38:53.706100 23672 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57116 (request call id 424) took 1854 ms (client timeout 1752 ms). Trace:
I20260807 13:38:53.706566 23582 raft_consensus.cc:2454] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
W20260807 13:38:53.706705 23672 rpcz_store.cc:269] 0807 13:38:51.851694 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.002137 (+150443us) service_pool.cc:227] Handling call
0807 13:38:53.703053 (+1700916us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5800004298. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:53.706005 (+ 2952us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":26874112}
W20260807 13:38:53.707232 23582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 278) took 2532 ms (client timeout 2644 ms). Trace:
I20260807 13:38:53.270953 23573 rpcz_store.cc:276] 0807 13:38:50.254438 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.371176 (+2116738us) service_pool.cc:227] Handling call
0807 13:38:52.397266 (+ 26090us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:38:52.397780 (+ 514us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:52.397817 (+ 37us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:38:52.398500 (+ 683us) log.cc:842] Serialized 52 byte log entry
0807 13:38:52.497452 (+ 98952us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:53.148515 (+651063us) log.cc:842] Serialized 14 byte log entry
0807 13:38:53.171229 (+ 22714us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:53.181342 (+ 10113us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:53.203556 (+ 22214us) raft_consensus.cc:1671] finished
0807 13:38:53.221095 (+ 17539us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:53.226665 (+ 5570us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13545,"prepare.queue_time_us":73643,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":27,"raft.queue_time_us":27812,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":5900,"thread_start_us":491115,"threads_started":2,"wal-append.queue_time_us":307700}
I20260807 13:38:53.723762 24845 raft_consensus.cc:482] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:53.723753 24578 consensus_queue.cc:1225] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer 5e0ea5aa0c6d4846a5ccc9962342e17a log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260807 13:38:53.724551 24845 raft_consensus.cc:504] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.725303 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:53.726150 24279 raft_consensus.cc:3032] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:53.726595 24279 raft_consensus.cc:729] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:53.727010 24845 leader_election.cc:288] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:53.728989 23672 raft_consensus.cc:3037] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:53.729239 24805 leader_election.cc:288] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:53.725525 24578 raft_consensus.cc:3032] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:38:53.668668 24856 consensus_queue.cc:1035] T c8a377464d3c4243989dd0c5f15cd3f1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260807 13:38:53.730049 24578 raft_consensus.cc:729] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:53.730942 24578 consensus_queue.cc:260] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.732221 24578 raft_consensus.cc:3037] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:53.733435 23677 raft_consensus.cc:1261] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:38:53.734616 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:53.663337 24485 consensus_queue.cc:1035] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260807 13:38:53.709029 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "608f7e63bc4648e0890e5f601c52736c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:53.728212 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220c24fa0c52459182e1e89c74331f3b" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:53.736613 23676 raft_consensus.cc:1261] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:38:53.736752 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:53.737103 23573 raft_consensus.cc:2379] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 1: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:53.737466 23571 raft_consensus.cc:3037] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:53.738092 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:53.711268 24647 raft_consensus.cc:482] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:53.740147 24647 raft_consensus.cc:504] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.741669 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:53.742273 23671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 389) took 2179 ms. Trace:
I20260807 13:38:53.742933 24647 leader_election.cc:288] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:53.742861 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:53.743615 24844 raft_consensus.cc:482] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:53.708973 24869 raft_consensus.cc:504] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.732074 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:53.737807 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "608f7e63bc4648e0890e5f601c52736c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:53.755867 24885 raft_consensus.cc:482] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:53.756531 24885 raft_consensus.cc:504] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.756968 23473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 268) took 2225 ms. Trace:
I20260807 13:38:53.757418 23676 raft_consensus.cc:1261] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:53.744274 24844 raft_consensus.cc:504] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.757949 24762 leader_election.cc:288] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:53.761807 24911 consensus_queue.cc:1046] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260807 13:38:53.763415 23684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 401) took 3544 ms. Trace:
I20260807 13:38:53.776737 23684 rpcz_store.cc:276] 0807 13:38:50.224365 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:51.201636 (+977271us) service_pool.cc:227] Handling call
0807 13:38:52.170880 (+969244us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.173323 (+ 2443us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:53.763165 (+1589842us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b5400030550. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ea09 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:53.763344 (+ 179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2227955456}
I20260807 13:38:53.727512 24279 consensus_queue.cc:260] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.743708 23679 raft_consensus.cc:2454] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4.
I20260807 13:38:53.687723 24847 consensus_queue.cc:1035] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260807 13:38:53.788563 24850 leader_election.cc:288] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:53.735523 23677 raft_consensus.cc:2379] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 3: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:53.742692 23671 rpcz_store.cc:276] 0807 13:38:51.562503 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.310995 (+748492us) service_pool.cc:227] Handling call
0807 13:38:52.311422 (+ 427us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:52.400958 (+ 89536us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:53.742006 (+1341048us) spinlock_profiling.cc:243] Waited 59.8 ms on lock 0x7b5400041354. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:53.742209 (+ 203us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":137511296}
I20260807 13:38:53.779893 24911 raft_consensus.cc:3032] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:38:53.780282 24885 leader_election.cc:288] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:53.780751 23674 raft_consensus.cc:1226] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:53.708640 23574 raft_consensus.cc:2454] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:53.782123 24905 leader_election.cc:288] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:53.716796 24417 raft_consensus.cc:504] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.759423 24863 raft_consensus.cc:3037] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:53.739463 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6ae70649fa43bba8052b66977418f5" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:53.789108 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6ae70649fa43bba8052b66977418f5" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:53.801366 23684 raft_consensus.cc:1261] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:38:53.664170 24893 consensus_queue.cc:260] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.805903 24909 raft_consensus.cc:482] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:53.808115 23737 tablet_bootstrap.cc:654] T 356c6b3e51454d418acaa9be70bb9689 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:53.797745 24802 raft_consensus.cc:482] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:53.795881 23675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57122 (request call id 374) took 3474 ms (client timeout 1949 ms). Trace:
W20260807 13:38:53.825661 23675 rpcz_store.cc:269] 0807 13:38:50.302507 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:50.357961 (+ 55454us) service_pool.cc:227] Handling call
0807 13:38:51.925406 (+1567445us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5800004298. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:53.761008 (+1835602us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b540028bed4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:53.776507 (+ 15499us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":466987776}
W20260807 13:38:53.708113 23582 rpcz_store.cc:269] 0807 13:38:51.174708 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:51.682422 (+507714us) service_pool.cc:227] Handling call
0807 13:38:52.736793 (+1054371us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:53.707162 (+970369us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":59030912}
I20260807 13:38:53.826926 24869 leader_election.cc:288] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:53.827517 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39707c5d97164544b9f5c03db41181c0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:53.828526 23582 raft_consensus.cc:2379] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 1: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:53.829387 24417 leader_election.cc:288] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:53.829493 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:53.831070 24674 consensus_meta.cc:287] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.508s user 0.010s sys 0.001s
I20260807 13:38:53.831542 24674 raft_consensus.cc:504] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.798579 24911 raft_consensus.cc:729] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:53.816012 24279 raft_consensus.cc:3037] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:53.834843 24802 raft_consensus.cc:504] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.757500 23473 rpcz_store.cc:276] 0807 13:38:51.531659 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.260049 (+728390us) service_pool.cc:227] Handling call
0807 13:38:52.260499 (+ 450us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:52.746223 (+485724us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:52.746261 (+ 38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:52.746857 (+ 596us) log.cc:842] Serialized 26 byte log entry
0807 13:38:53.190988 (+444131us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:53.755735 (+564747us) log.cc:842] Serialized 14 byte log entry
0807 13:38:53.756458 (+ 723us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:53.756664 (+ 206us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:53.756730 (+ 66us) raft_consensus.cc:1671] finished
0807 13:38:53.756746 (+ 16us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:53.756898 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":485256,"raft.queue_time_us":572040,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":65580,"thread_start_us":934438,"threads_started":2,"wal-append.queue_time_us":544974}
I20260807 13:38:53.816682 24908 leader_election.cc:288] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:53.824422 23572 raft_consensus.cc:3037] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:53.851464 24844 leader_election.cc:288] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:53.589965 23471 rpcz_store.cc:276] 0807 13:38:51.404584 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.134909 (+730325us) service_pool.cc:227] Handling call
0807 13:38:52.168869 (+ 33960us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:52.292580 (+123711us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:52.292614 (+ 34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:52.332763 (+ 40149us) log.cc:842] Serialized 26 byte log entry
0807 13:38:52.579483 (+246720us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:38:52.585915 (+ 6432us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:52.591022 (+ 5107us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:53.288344 (+697322us) raft_consensus.cc:1671] finished
0807 13:38:53.290921 (+ 2577us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:53.325235 (+ 34314us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":558462,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"thread_start_us":320276,"threads_started":2,"wal-append.queue_time_us":383215}
I20260807 13:38:53.853510 24903 raft_consensus.cc:504] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.850893 24417 raft_consensus.cc:482] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:53.838721 23582 raft_consensus.cc:2362] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4. Re-sending same reply.
W20260807 13:38:53.879371 24746 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.761s user 0.017s sys 0.023s
I20260807 13:38:53.878391 24674 leader_election.cc:288] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:53.856339 24802 leader_election.cc:288] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:53.904862 24746 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.807s user 0.018s sys 0.023s
I20260807 13:38:53.919425 23580 raft_consensus.cc:1261] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:53.879730 24911 consensus_queue.cc:260] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.920342 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 397) took 2954 ms. Trace:
I20260807 13:38:53.920670 23580 rpcz_store.cc:276] 0807 13:38:50.966112 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.627631 (+1661519us) service_pool.cc:227] Handling call
0807 13:38:52.628104 (+ 473us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:53.919099 (+1290995us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b540042a520. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc697fef730 00007fc698061ec7 00007fc6980625b0 00007fc69805eedf 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc
0807 13:38:53.919983 (+ 884us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:53.920263 (+ 280us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":41313536}
I20260807 13:38:53.841496 24909 raft_consensus.cc:504] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.924131 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:53.900028 24417 raft_consensus.cc:504] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.917407 24908 raft_consensus.cc:482] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:53.934906 23580 raft_consensus.cc:3037] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:38:53.925122 24507 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260807 13:38:53.920889 24911 raft_consensus.cc:3037] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:53.932492 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:53.951210 23680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 403) took 1614 ms. Trace:
I20260807 13:38:54.012562 23680 rpcz_store.cc:276] 0807 13:38:52.337251 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.521497 (+184246us) service_pool.cc:227] Handling call
0807 13:38:52.521964 (+ 467us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:53.262801 (+740837us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:53.947171 (+684370us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b54003462d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:53.951134 (+ 3963us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1624711936}
I20260807 13:38:53.956604 24746 raft_consensus.cc:482] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:53.957621 24919 raft_consensus.cc:482] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:53.958325 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:53.942524 24417 leader_election.cc:288] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:53.965816 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:53.969429 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:53.970186 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:53.971376 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:53.973629 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:53.976171 24898 raft_consensus.cc:3037] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:53.976729 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:53.976193 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:53.861148 24721 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.568s user 0.000s sys 0.027s
I20260807 13:38:53.938581 24908 raft_consensus.cc:504] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:53.989476 24844 raft_consensus.cc:482] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:54.001343 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:54.001756 23739 tablet_bootstrap.cc:492] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:54.045150 23739 ts_tablet_manager.cc:1397] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.773s user 0.015s sys 0.026s
I20260807 13:38:54.004084 23740 tablet_bootstrap.cc:492] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:54.046496 23740 ts_tablet_manager.cc:1397] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 1.096s user 0.024s sys 0.015s
I20260807 13:38:54.004211 24652 raft_consensus.cc:3037] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:53.991852 23571 raft_consensus.cc:2454] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4.
I20260807 13:38:53.990451 24903 leader_election.cc:288] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:53.993635 24831 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.989s user 0.006s sys 0.015s
I20260807 13:38:53.793838 23581 raft_consensus.cc:2454] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 5.
W20260807 13:38:54.009558 24820 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.714s user 0.009s sys 0.030s
I20260807 13:38:54.023167 23479 raft_consensus.cc:2379] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:54.035055 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "608f7e63bc4648e0890e5f601c52736c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:54.052687 23480 raft_consensus.cc:2454] T 608f7e63bc4648e0890e5f601c52736c P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:54.053551 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6ae70649fa43bba8052b66977418f5" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:54.018545 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 446025us
I20260807 13:38:54.008282 24732 raft_consensus.cc:482] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:54.039346 23580 raft_consensus.cc:2454] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
W20260807 13:38:54.021920 24738 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.829s user 0.015s sys 0.003s
W20260807 13:38:53.983417 23430 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.714s user 0.016s sys 0.062s
W20260807 13:38:54.036765 24721 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.746s user 0.000s sys 0.028s
I20260807 13:38:54.055706 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:54.056066 23430 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.787s user 0.016s sys 0.062s
I20260807 13:38:54.036257 23578 raft_consensus.cc:3037] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:54.058007 23633 leader_election.cc:302] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
W20260807 13:38:54.052153 24820 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.757s user 0.009s sys 0.030s
I20260807 13:38:54.058902 23472 raft_consensus.cc:2379] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 4: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:54.055084 23470 raft_consensus.cc:2379] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:54.059206 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:54.025712 23471 raft_consensus.cc:2454] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:54.071040 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:54.059888 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:54.072903 23479 raft_consensus.cc:3037] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:54.062973 23633 leader_election.cc:302] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
W20260807 13:38:54.063762 23533 leader_election.cc:341] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:54.034660 23572 raft_consensus.cc:2454] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
W20260807 13:38:54.076364 23533 leader_election.cc:341] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:38:54.054489 24831 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.044s user 0.006s sys 0.015s
I20260807 13:38:54.079763 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220c24fa0c52459182e1e89c74331f3b" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:54.017963 24746 raft_consensus.cc:504] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:54.085493 23533 leader_election.cc:341] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:54.090890 23533 leader_election.cc:302] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
W20260807 13:38:54.055459 24738 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.872s user 0.015s sys 0.003s
I20260807 13:38:54.049157 24909 leader_election.cc:288] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:54.053097 24843 raft_consensus.cc:482] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:54.055847 24417 raft_consensus.cc:482] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:54.068058 24519 raft_consensus.cc:482] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:54.060602 24320 raft_consensus.cc:482] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:54.094440 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "356c6b3e51454d418acaa9be70bb9689" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:54.052342 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:54.069612 24802 raft_consensus.cc:482] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:54.088121 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:54.086135 23473 raft_consensus.cc:2396] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:38:54.105039 23580 raft_consensus.cc:2454] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4.
I20260807 13:38:54.101533 23631 leader_election.cc:302] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters: 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:54.106452 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:54.106710 23633 leader_election.cc:302] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:54.106794 23631 leader_election.cc:302] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:54.022912 24919 raft_consensus.cc:504] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.103149 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:54.108961 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:54.107427 23580 raft_consensus.cc:2354] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4.
I20260807 13:38:54.141739 23680 raft_consensus.cc:3037] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:54.050078 24844 raft_consensus.cc:504] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:54.100481 23533 consensus_peers.cc:487] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 -> Peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Couldn't send request to peer 5e0ea5aa0c6d4846a5ccc9962342e17a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:38:54.092366 24805 raft_consensus.cc:2726] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:54.085493 24831 raft_consensus.cc:686] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:54.096246 24819 raft_consensus.cc:482] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:54.096794 24881 raft_consensus.cc:2781] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:38:54.141207 23479 raft_consensus.cc:2454] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4.
I20260807 13:38:54.159161 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:54.108300 23631 leader_election.cc:302] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:54.078907 24931 raft_consensus.cc:2781] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:54.095885 24929 raft_consensus.cc:482] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:54.092330 24869 raft_consensus.cc:482] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:54.061091 24732 raft_consensus.cc:504] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.144928 23582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 294) took 1047 ms. Trace:
I20260807 13:38:54.108448 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:54.145751 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a3da79d3b0447cbc19c4f28279e134" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:54.136881 24856 raft_consensus.cc:2781] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:38:54.108639 24320 raft_consensus.cc:504] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.147157 24863 consensus_queue.cc:1035] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:38:54.145833 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:54.148999 24893 raft_consensus.cc:3037] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:54.101091 24417 raft_consensus.cc:504] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.101461 24843 raft_consensus.cc:504] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.154246 23429 leader_election.cc:302] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
W20260807 13:38:54.164228 23533 consensus_peers.cc:487] T 356c6b3e51454d418acaa9be70bb9689 P 9ae273efd33642ad970ab8d1973917c1 -> Peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Couldn't send request to peer 5e0ea5aa0c6d4846a5ccc9962342e17a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:38:54.161285 23680 raft_consensus.cc:2454] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4.
I20260807 13:38:54.102778 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:54.160616 23479 raft_consensus.cc:2454] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4.
I20260807 13:38:54.133529 24873 raft_consensus.cc:2726] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:54.187747 23533 leader_election.cc:398] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Vote denied by peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765) with higher term. Message: Invalid argument: T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 2. Current term is 3.
I20260807 13:38:54.188148 23533 leader_election.cc:401] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 13:38:54.142202 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39707c5d97164544b9f5c03db41181c0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:54.106349 24519 raft_consensus.cc:504] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.157127 24908 leader_election.cc:288] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:54.153312 24905 consensus_queue.cc:1035] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:54.156868 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:54.200626 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:54.201188 23677 raft_consensus.cc:2379] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 3: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:54.201498 23481 raft_consensus.cc:2379] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:54.201306 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:54.175371 24856 raft_consensus.cc:482] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:54.142407 24845 raft_consensus.cc:482] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:54.143071 24860 consensus_queue.cc:1035] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
I20260807 13:38:54.169919 24738 consensus_queue.cc:1035] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260807 13:38:54.190809 23533 leader_election.cc:302] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:54.175817 24931 raft_consensus.cc:686] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:54.193596 23571 raft_consensus.cc:3037] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 4
I20260807 13:38:54.185420 24857 raft_consensus.cc:2726] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:54.197634 24746 leader_election.cc:288] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:54.197471 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9fcdd060ef64874a8719c95b2325942" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:54.198449 24873 raft_consensus.cc:482] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:54.204272 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 50112.8us
I20260807 13:38:54.224200 23429 leader_election.cc:302] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:54.224442 23481 raft_consensus.cc:1261] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260807 13:38:54.187063 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 78857.9us
I20260807 13:38:54.167542 24802 raft_consensus.cc:504] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.180051 23478 raft_consensus.cc:2454] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:54.213114 24845 raft_consensus.cc:504] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.220717 24908 raft_consensus.cc:2781] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:54.178473 24869 raft_consensus.cc:504] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.211530 24856 raft_consensus.cc:3037] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:54.195890 23473 raft_consensus.cc:3037] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:54.169303 24819 raft_consensus.cc:504] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.169983 23582 rpcz_store.cc:276] 0807 13:38:53.097746 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.016389 (+918643us) service_pool.cc:227] Handling call
0807 13:38:54.144851 (+128462us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:54.220520 23533 leader_election.cc:302] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:54.169126 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9fcdd060ef64874a8719c95b2325942" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:54.231086 23739 raft_consensus.cc:348] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.264290 23739 raft_consensus.cc:374] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:54.264590 23739 raft_consensus.cc:729] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:54.265333 23739 consensus_queue.cc:260] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.265829 24434 raft_consensus.cc:2781] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:54.267202 23739 ts_tablet_manager.cc:1428] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.222s user 0.006s sys 0.002s
I20260807 13:38:54.203091 23471 raft_consensus.cc:3037] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:54.267715 24578 consensus_queue.cc:1046] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 3.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:54.211304 24905 raft_consensus.cc:2726] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:38:54.235582 23479 raft_consensus.cc:1261] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260807 13:38:54.268615 24850 raft_consensus.cc:3032] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:38:54.268791 23479 pending_rounds.cc:76] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613: Aborting all ops after (but not including) 1
I20260807 13:38:54.220479 23740 raft_consensus.cc:348] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.269012 24850 raft_consensus.cc:729] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:54.204572 23469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 445) took 2741 ms. Trace:
I20260807 13:38:54.227221 24909 raft_consensus.cc:482] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:54.236253 24746 consensus_queue.cc:1046] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260807 13:38:54.269865 23469 rpcz_store.cc:276] 0807 13:38:51.454025 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.135845 (+681820us) service_pool.cc:227] Handling call
0807 13:38:53.512971 (+1377126us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:53.552331 (+ 39360us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:54.179742 (+627411us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54001e1ed0. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ea09 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:54.194821 (+ 15079us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3062907264}
I20260807 13:38:54.270416 24909 raft_consensus.cc:504] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.271704 24924 raft_consensus.cc:3032] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:54.272202 24924 raft_consensus.cc:729] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:54.272763 24909 leader_election.cc:288] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:54.274617 24417 leader_election.cc:288] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:54.170437 24929 raft_consensus.cc:504] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.272269 24850 consensus_queue.cc:260] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.1, Last appended by leader: 1, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.275892 24850 raft_consensus.cc:3037] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:54.261561 24831 consensus_queue.cc:237] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.277249 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:54.278905 23582 raft_consensus.cc:2362] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3. Re-sending same reply.
I20260807 13:38:54.280889 24417 raft_consensus.cc:2781] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:38:54.281433 24417 raft_consensus.cc:482] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:54.269410 23740 raft_consensus.cc:374] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:54.282338 23740 raft_consensus.cc:729] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:54.282742 23469 raft_consensus.cc:1226] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 2. Current term is 3. Ops: []
W20260807 13:38:54.282591 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 62142.3us
I20260807 13:38:54.283272 23740 consensus_queue.cc:260] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.284368 23533 leader_election.cc:302] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:54.285254 23740 ts_tablet_manager.cc:1428] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.238s user 0.004s sys 0.003s
I20260807 13:38:54.285738 24909 consensus_queue.cc:1046] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:54.281884 24417 raft_consensus.cc:3037] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Advancing to term 5
W20260807 13:38:54.268903 23429 leader_election.cc:341] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:54.194638 24806 consensus_queue.cc:1046] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260807 13:38:54.287097 24740 raft_consensus.cc:2781] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:54.290236 23429 leader_election.cc:302] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:54.269097 23479 pending_rounds.cc:97] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260807 13:38:54.304543 23479 raft_consensus.cc:2866] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:38:54.234485 24860 raft_consensus.cc:2781] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:38:54.306382 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:54.312641 23631 leader_election.cc:302] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:54.262569 24320 leader_election.cc:288] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:54.322086 23631 leader_election.cc:302] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:54.323189 23533 leader_election.cc:398] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765) with higher term. Message: Invalid argument: T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4.
I20260807 13:38:54.323546 23533 leader_election.cc:401] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:38:54.261422 24802 leader_election.cc:288] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:54.316847 23739 tablet_bootstrap.cc:492] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:54.324206 24929 leader_election.cc:288] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:54.286379 23740 tablet_bootstrap.cc:492] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:38:54.324764 23631 leader_election.cc:302] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
W20260807 13:38:54.260653 24934 log.cc:924] Time spent T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.117s user 0.000s sys 0.000s
I20260807 13:38:54.321170 23581 raft_consensus.cc:2454] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4.
I20260807 13:38:54.273578 24924 consensus_queue.cc:260] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.261656 24732 leader_election.cc:288] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:54.301612 24857 raft_consensus.cc:482] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:54.259984 24932 raft_consensus.cc:482] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:54.261193 24845 leader_election.cc:288] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:54.350207 23633 leader_election.cc:302] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:54.350905 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a3da79d3b0447cbc19c4f28279e134" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:54.356527 23581 raft_consensus.cc:2454] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 0.
I20260807 13:38:54.260035 24943 raft_consensus.cc:482] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:54.324914 24860 raft_consensus.cc:482] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:54.232528 24873 raft_consensus.cc:504] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.238212 24908 raft_consensus.cc:482] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:54.354126 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:54.393016 23479 raft_consensus.cc:2379] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 2: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:54.300289 24830 raft_consensus.cc:482] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:54.306994 24740 raft_consensus.cc:482] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:54.357681 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:54.399492 23581 raft_consensus.cc:2454] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:54.327971 24881 raft_consensus.cc:686] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:54.358924 23582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 279) took 3160 ms. Trace:
I20260807 13:38:54.399529 24345 raft_consensus.cc:482] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:54.404093 23582 rpcz_store.cc:276] 0807 13:38:51.198843 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.325433 (+3126590us) service_pool.cc:227] Handling call
0807 13:38:54.358348 (+ 32915us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:54.358559 (+ 211us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:54.358594 (+ 35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:54.358636 (+ 42us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:54.358672 (+ 36us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:54.358731 (+ 59us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:54.358848 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:54.404837 24345 raft_consensus.cc:504] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.370182 24869 leader_election.cc:288] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:54.406229 24845 raft_consensus.cc:2781] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:38:54.406591 23582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 289) took 2216 ms. Trace:
I20260807 13:38:54.406843 24845 raft_consensus.cc:482] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:54.359464 24806 raft_consensus.cc:3032] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:54.360739 23533 leader_election.cc:398] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765) with higher term. Message: Invalid argument: T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 2. Current term is 3.
I20260807 13:38:54.407405 24845 raft_consensus.cc:3037] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:54.407799 23533 leader_election.cc:401] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:38:54.320413 24916 raft_consensus.cc:2781] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:38:54.408524 24916 raft_consensus.cc:686] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 4 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:54.238117 24279 consensus_queue.cc:1035] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.113s
I20260807 13:38:54.305579 23575 raft_consensus.cc:2454] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:54.391578 24860 raft_consensus.cc:3037] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:54.327782 24944 raft_consensus.cc:482] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:54.358273 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:54.351315 24942 raft_consensus.cc:2726] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:54.263768 24903 consensus_queue.cc:1046] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
I20260807 13:38:54.436360 24903 raft_consensus.cc:3032] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:54.436790 24903 raft_consensus.cc:729] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:54.437813 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 400) took 3470 ms. Trace:
I20260807 13:38:54.437469 24944 raft_consensus.cc:504] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.438182 23580 rpcz_store.cc:276] 0807 13:38:50.967183 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.156607 (+3189424us) service_pool.cc:227] Handling call
0807 13:38:54.436957 (+280350us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:38:54.437198 (+ 241us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:54.437561 (+ 363us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:54.437742 (+ 181us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3551104}
I20260807 13:38:54.423127 24929 raft_consensus.cc:482] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:54.440069 24929 raft_consensus.cc:504] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.391508 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:54.393625 24924 raft_consensus.cc:3037] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:54.398242 24908 raft_consensus.cc:3037] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:54.407473 24806 raft_consensus.cc:729] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:54.401111 24740 raft_consensus.cc:3037] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:54.429020 23575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 303) took 1218 ms. Trace:
I20260807 13:38:54.437602 24903 consensus_queue.cc:260] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.426553 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:54.260717 24931 consensus_queue.cc:237] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.443135 23580 raft_consensus.cc:1261] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:38:54.361181 24945 raft_consensus.cc:2726] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:38:54.361153 24857 raft_consensus.cc:504] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.391786 24943 raft_consensus.cc:504] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.369143 24932 raft_consensus.cc:504] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.731957 23581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 284) took 3047 ms. Trace:
W20260807 13:38:54.552286 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 227567us
W20260807 13:38:54.749977 23574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 297) took 1651 ms (client timeout 2009 ms). Trace:
I20260807 13:38:54.786149 23581 rpcz_store.cc:276] 0807 13:38:51.684132 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.401967 (+2717835us) service_pool.cc:227] Handling call
0807 13:38:54.402346 (+ 379us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:54.402554 (+ 208us) raft_consensus.cc:1520] Early marking committed up to index 1
0807 13:38:54.692243 (+289689us) log.cc:842] Serialized 14 byte log entry
0807 13:38:54.731591 (+ 39348us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:54.731661 (+ 70us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:54.731700 (+ 39us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:54.731765 (+ 65us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:54.731886 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":3948,"thread_start_us":326955,"threads_started":2}
W20260807 13:38:54.449133 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 88540.3us
W20260807 13:38:54.492822 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 143252us
I20260807 13:38:54.409704 24844 leader_election.cc:288] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:54.400338 24946 raft_consensus.cc:2781] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:38:54.473876 23737 tablet_bootstrap.cc:492] T 356c6b3e51454d418acaa9be70bb9689 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
W20260807 13:38:54.786324 24850 consensus_meta.cc:287] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.510s user 0.013s sys 0.010s
I20260807 13:38:54.801071 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 300) took 1685 ms. Trace:
I20260807 13:38:54.803347 23737 ts_tablet_manager.cc:1397] T 356c6b3e51454d418acaa9be70bb9689 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 1.187s user 0.035s sys 0.051s
W20260807 13:38:54.797614 24926 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s user 0.011s sys 0.014s
I20260807 13:38:54.800446 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:54.786237 24940 log.cc:924] Time spent T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.432s user 0.000s sys 0.002s
W20260807 13:38:54.484409 24933 log.cc:924] Time spent T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.322s user 0.002s sys 0.002s
I20260807 13:38:54.431015 23672 raft_consensus.cc:1261] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:38:54.477255 24948 raft_consensus.cc:3037] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 3
I20260807 13:38:54.809667 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:54.530658 23469 raft_consensus.cc:2379] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 2: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:54.573051 24949 raft_consensus.cc:482] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:54.794250 24911 consensus_meta.cc:287] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.776s user 0.016s sys 0.008s
I20260807 13:38:54.638692 24738 raft_consensus.cc:482] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:54.801959 24873 leader_election.cc:288] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:54.788600 24843 leader_election.cc:288] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:54.806924 24844 raft_consensus.cc:482] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:54.816334 24926 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s user 0.011s sys 0.014s
I20260807 13:38:54.799371 24647 raft_consensus.cc:482] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:54.789376 24721 raft_consensus.cc:482] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:54.823875 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:54.800295 24819 leader_election.cc:288] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:54.860400 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a3da79d3b0447cbc19c4f28279e134" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:54.411787 24830 raft_consensus.cc:504] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.823619 24929 leader_election.cc:288] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:54.649484 24944 leader_election.cc:288] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:54.804131 24946 raft_consensus.cc:482] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:54.818423 23479 raft_consensus.cc:2379] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:54.849987 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:54.787410 24806 consensus_queue.cc:260] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:54.856895 23475 consensus_meta.cc:287] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.816s user 0.019s sys 0.000s
I20260807 13:38:54.797761 23575 rpcz_store.cc:276] 0807 13:38:53.210818 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.099016 (+888198us) service_pool.cc:227] Handling call
0807 13:38:54.428917 (+329901us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:54.854938 23633 leader_election.cc:302] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:54.801700 24732 consensus_queue.cc:1035] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260807 13:38:54.861078 23480 raft_consensus.cc:2454] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 0.
I20260807 13:38:54.808955 23580 rpcz_store.cc:276] 0807 13:38:53.115945 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.439125 (+1323180us) service_pool.cc:227] Handling call
0807 13:38:54.439560 (+ 435us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:54.797033 (+357473us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:54.801005 (+ 3972us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:54.548544 24881 consensus_queue.cc:237] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 3.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.810897 24320 consensus_queue.cc:1035] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.048s
I20260807 13:38:54.842650 24507 raft_consensus.cc:482] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:54.853446 24898 consensus_meta.cc:287] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.811s user 0.015s sys 0.008s
I20260807 13:38:54.498531 24916 consensus_queue.cc:237] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.843812 24949 raft_consensus.cc:504] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.859617 24738 raft_consensus.cc:504] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:54.787575 23574 rpcz_store.cc:269] 0807 13:38:53.098700 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:53.218997 (+120297us) service_pool.cc:227] Handling call
0807 13:38:54.728708 (+1509711us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54002edbd4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:54.741993 (+ 13285us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1033638272}
W20260807 13:38:54.865432 24947 log.cc:924] Time spent T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.317s user 0.001s sys 0.000s
I20260807 13:38:54.877565 23581 raft_consensus.cc:2454] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:38:54.407073 23582 rpcz_store.cc:276] 0807 13:38:52.189770 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.405583 (+2215813us) service_pool.cc:227] Handling call
0807 13:38:54.405981 (+ 398us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:54.406177 (+ 196us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:54.406228 (+ 51us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:54.406287 (+ 59us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:54.406318 (+ 31us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:54.406376 (+ 58us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:54.406528 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:54.877262 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:54.886771 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:54.875578 24843 consensus_queue.cc:1035] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
I20260807 13:38:54.859052 24873 consensus_queue.cc:1035] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.025s
I20260807 13:38:54.893610 24944 raft_consensus.cc:2781] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:38:54.859020 24844 raft_consensus.cc:504] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.908468 24949 leader_election.cc:288] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:54.876945 24946 raft_consensus.cc:3037] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:54.909003 24844 leader_election.cc:288] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
W20260807 13:38:54.877146 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 76215.9us
W20260807 13:38:54.887663 24951 log.cc:924] Time spent T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.067s user 0.000s sys 0.001s
I20260807 13:38:54.861943 24647 raft_consensus.cc:504] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.918555 24647 leader_election.cc:288] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:54.897959 24962 raft_consensus.cc:482] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:54.864581 24721 raft_consensus.cc:504] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.882329 23475 raft_consensus.cc:2454] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:38:54.887411 23577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 253) took 4707 ms. Trace:
I20260807 13:38:54.921904 23481 raft_consensus.cc:1261] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:54.888052 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:54.905546 24830 leader_election.cc:288] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:54.885242 23677 raft_consensus.cc:2454] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:54.895324 24806 raft_consensus.cc:3037] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:54.911348 23631 leader_election.cc:302] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
W20260807 13:38:54.915542 24652 consensus_meta.cc:287] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.863s user 0.009s sys 0.003s
I20260807 13:38:54.904501 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:54.920070 24932 leader_election.cc:288] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:54.920625 23578 consensus_meta.cc:287] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.830s user 0.019s sys 0.007s
I20260807 13:38:54.920737 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:54.888489 23633 leader_election.cc:302] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:54.898756 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:54.923749 23577 rpcz_store.cc:276] 0807 13:38:50.180361 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:52.212247 (+2031886us) service_pool.cc:227] Handling call
0807 13:38:53.799231 (+1586984us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:38:53.799473 (+ 242us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:53.806282 (+ 6809us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:53.806324 (+ 42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:53.806941 (+ 617us) log.cc:842] Serialized 26 byte log entry
0807 13:38:54.094000 (+287059us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:54.100114 (+ 6114us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:54.126687 (+ 26573us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:54.441737 (+315050us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b44000232cc. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc695049a95 00007fc69504a4b2 00007fc697cf2511 00007fc697cede1a 00007fc697ce1bee 00007fc697ce0f36 00007fc697ce0b58 00007fc697cea551 00007fc697cea509 00007fc697cea499
0807 13:38:54.878135 (+436398us) raft_consensus.cc:1671] finished
0807 13:38:54.879174 (+ 1039us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:54.884842 (+ 5668us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":339,"raft.queue_time_us":7990,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":7534,"spinlock_wait_cycles":37834240,"thread_start_us":272405,"threads_started":1,"wal-append.queue_time_us":347043}
I20260807 13:38:54.923851 24860 raft_consensus.cc:504] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.906205 24944 raft_consensus.cc:482] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:38:54.927611 23571 consensus_meta.cc:287] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.691s user 0.007s sys 0.005s
I20260807 13:38:54.935578 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:54.936868 23575 raft_consensus.cc:1226] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 2. Current term is 3. Ops: []
I20260807 13:38:54.933493 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:54.947772 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 59336.4us
I20260807 13:38:54.896263 24507 raft_consensus.cc:504] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.949249 23740 tablet_bootstrap.cc:654] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:55.031390 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:54.928504 24856 consensus_meta.cc:287] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.662s user 0.012s sys 0.001s
I20260807 13:38:55.015389 23533 leader_election.cc:302] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:55.063359 23739 tablet_bootstrap.cc:700] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613: Time spent opening tablet: real 0.133s user 0.005s sys 0.001s
I20260807 13:38:55.077152 23739 tablet_bootstrap.cc:654] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:55.030958 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:55.060001 23679 raft_consensus.cc:1226] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4. Ops: []
I20260807 13:38:55.078127 23480 raft_consensus.cc:2454] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:38:55.078750 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:55.079537 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 64287.4us
I20260807 13:38:55.080269 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:55.081044 23679 raft_consensus.cc:2454] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
I20260807 13:38:55.082036 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b078a19f38494b04ad11b14d98ec4bca" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:55.083190 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:55.083420 23633 leader_election.cc:302] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:55.083806 23679 raft_consensus.cc:3037] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:55.090071 23533 leader_election.cc:302] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
W20260807 13:38:55.091261 23533 leader_election.cc:341] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:55.031889 23737 raft_consensus.cc:348] T 356c6b3e51454d418acaa9be70bb9689 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:54.940384 24942 raft_consensus.cc:482] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:55.094329 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:55.053295 24845 consensus_meta.cc:287] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.645s user 0.013s sys 0.000s
I20260807 13:38:54.929497 24943 leader_election.cc:288] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:54.994601 24652 raft_consensus.cc:2781] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:55.098091 24932 raft_consensus.cc:2781] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:38:55.108034 24652 raft_consensus.cc:482] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:55.051124 24907 raft_consensus.cc:3032] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:38:55.108197 24932 raft_consensus.cc:482] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:55.108317 23633 leader_election.cc:302] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:55.108793 24907 raft_consensus.cc:729] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:55.108948 24932 raft_consensus.cc:3037] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:55.105535 24845 raft_consensus.cc:504] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.052186 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:55.030433 24919 leader_election.cc:288] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:55.073575 24944 raft_consensus.cc:3037] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:55.089564 23582 raft_consensus.cc:1261] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260807 13:38:55.090514 24934 log.cc:924] Time spent T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.060s user 0.000s sys 0.000s
I20260807 13:38:55.098186 24953 raft_consensus.cc:2781] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:55.021612 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:55.052759 24345 leader_election.cc:288] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:55.018491 24738 leader_election.cc:288] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:55.112920 24652 raft_consensus.cc:3037] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:55.110227 23575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 411) took 1885 ms. Trace:
I20260807 13:38:54.952941 24830 raft_consensus.cc:2726] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:38:55.118819 24507 leader_election.cc:288] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:55.110128 24942 raft_consensus.cc:504] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.112138 24898 raft_consensus.cc:482] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:55.063856 23571 raft_consensus.cc:2454] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4.
I20260807 13:38:55.109694 24907 consensus_queue.cc:260] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.122113 23633 leader_election.cc:302] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:55.088282 23672 raft_consensus.cc:2454] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:55.092856 23737 raft_consensus.cc:374] T 356c6b3e51454d418acaa9be70bb9689 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:55.114632 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:55.090267 23574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 302) took 1891 ms. Trace:
I20260807 13:38:55.129925 23679 raft_consensus.cc:2454] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 5.
W20260807 13:38:55.196050 23471 consensus_meta.cc:287] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.926s user 0.000s sys 0.021s
I20260807 13:38:55.208741 23681 raft_consensus.cc:2454] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 5.
I20260807 13:38:54.942101 23578 raft_consensus.cc:2454] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:55.113364 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:55.094393 24965 raft_consensus.cc:2726] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:38:55.139281 24417 consensus_meta.cc:287] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.852s user 0.023s sys 0.002s
I20260807 13:38:55.180840 23577 raft_consensus.cc:1261] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:55.178330 24953 raft_consensus.cc:482] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:55.114486 24819 consensus_queue.cc:1035] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260807 13:38:55.215866 24953 raft_consensus.cc:3037] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:55.192669 24721 leader_election.cc:288] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:55.199100 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 77117.9us
I20260807 13:38:55.091918 24856 raft_consensus.cc:504] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.186662 24845 leader_election.cc:288] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:55.138182 23581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 301) took 2021 ms. Trace:
I20260807 13:38:55.203920 24963 raft_consensus.cc:482] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:55.204447 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cd369f3fbdf4b61a5fd1e85690c9ba4" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:55.204736 23533 leader_election.cc:302] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:55.221726 23581 rpcz_store.cc:276] 0807 13:38:53.116815 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.900363 (+1783548us) service_pool.cc:227] Handling call
0807 13:38:54.900712 (+ 349us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:54.901001 (+ 289us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:54.901018 (+ 17us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:54.901357 (+ 339us) log.cc:842] Serialized 26 byte log entry
0807 13:38:55.110621 (+209264us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:55.110657 (+ 36us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:55.110727 (+ 70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:55.137869 (+ 27142us) raft_consensus.cc:1671] finished
0807 13:38:55.137898 (+ 29us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:55.138086 (+ 188us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2728,"raft.queue_time_us":98,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":3414,"thread_start_us":186138,"threads_started":1,"wal-append.queue_time_us":229902}
I20260807 13:38:55.223322 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:55.223686 23533 leader_election.cc:302] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:55.207556 24647 raft_consensus.cc:2781] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:55.190426 23582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 404) took 1967 ms. Trace:
I20260807 13:38:55.185271 23575 rpcz_store.cc:276] 0807 13:38:53.225061 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.936260 (+1711199us) service_pool.cc:227] Handling call
0807 13:38:54.936649 (+ 389us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:55.070997 (+134348us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:55.103394 (+ 32397us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:55.210741 23684 raft_consensus.cc:2454] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:38:55.208470 24881 raft_consensus.cc:2781] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:54.923542 24962 raft_consensus.cc:504] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.187709 23475 raft_consensus.cc:2362] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4. Re-sending same reply.
I20260807 13:38:55.199545 24802 raft_consensus.cc:2726] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765) with higher term. Message: Invalid argument: T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4.
I20260807 13:38:55.201858 23737 raft_consensus.cc:729] T 356c6b3e51454d418acaa9be70bb9689 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:55.248317 24948 raft_consensus.cc:2726] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765) with higher term. Message: Invalid argument: T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 2. Current term is 3.
I20260807 13:38:55.248692 23737 consensus_queue.cc:260] T 356c6b3e51454d418acaa9be70bb9689 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.200680 24908 raft_consensus.cc:504] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.203996 23571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 309) took 1689 ms. Trace:
I20260807 13:38:55.199856 23675 raft_consensus.cc:2454] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
W20260807 13:38:55.221180 23578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 408) took 1995 ms (client timeout 1515 ms). Trace:
I20260807 13:38:55.225047 24840 raft_consensus.cc:2781] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:55.225538 24965 raft_consensus.cc:2781] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:38:55.210728 24907 raft_consensus.cc:3037] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:55.205762 23739 tablet_bootstrap.cc:492] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:55.213105 24805 raft_consensus.cc:2726] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765) with higher term. Message: Invalid argument: T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 2. Current term is 3.
I20260807 13:38:55.214478 24417 raft_consensus.cc:504] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.209903 23469 raft_consensus.cc:2454] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 5.
I20260807 13:38:55.238600 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:55.222402 24893 consensus_meta.cc:287] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 1.032s user 0.011s sys 0.015s
I20260807 13:38:55.208369 23471 raft_consensus.cc:2454] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:38:55.268045 23471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 449) took 1180 ms. Trace:
I20260807 13:38:55.198771 24898 raft_consensus.cc:504] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.237417 24881 raft_consensus.cc:482] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:55.214282 24860 leader_election.cc:288] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:55.231914 23582 rpcz_store.cc:276] 0807 13:38:53.222554 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.906827 (+1684273us) service_pool.cc:227] Handling call
0807 13:38:55.024585 (+117758us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:55.133663 (+109078us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:55.188253 (+ 54590us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:55.232755 24963 raft_consensus.cc:504] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.243538 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:55.244128 23473 consensus_meta.cc:287] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.919s user 0.010s sys 0.005s
I20260807 13:38:55.246632 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 297) took 1266 ms. Trace:
I20260807 13:38:55.233951 24845 raft_consensus.cc:482] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:55.251437 23571 rpcz_store.cc:276] 0807 13:38:53.512849 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.079509 (+566660us) service_pool.cc:227] Handling call
0807 13:38:55.201748 (+1122239us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:55.253849 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:55.254415 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:55.272825 23672 raft_consensus.cc:2454] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:55.286363 23480 raft_consensus.cc:2354] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 2. Current term is 3.
I20260807 13:38:55.286550 23472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 303) took 1196 ms. Trace:
I20260807 13:38:55.286630 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:55.287111 23472 rpcz_store.cc:276] 0807 13:38:54.090507 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:55.243201 (+1152694us) service_pool.cc:227] Handling call
0807 13:38:55.286480 (+ 43279us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:55.287425 23469 raft_consensus.cc:2454] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:55.263341 24965 raft_consensus.cc:686] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 5 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:55.272411 24507 raft_consensus.cc:482] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:55.235150 23533 leader_election.cc:341] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:38:55.264612 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 1.03033e+06us
I20260807 13:38:55.293931 23633 leader_election.cc:302] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
W20260807 13:38:55.294139 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 59064.4us
I20260807 13:38:55.263103 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:55.266528 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:55.267402 24908 leader_election.cc:288] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:55.256263 24840 raft_consensus.cc:482] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:55.282277 23481 rpcz_store.cc:276] 0807 13:38:53.980579 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.230126 (+249547us) service_pool.cc:227] Handling call
0807 13:38:54.921544 (+691418us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:54.922261 (+ 717us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:55.246356 (+324095us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b5400085550. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ea09 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:55.246558 (+ 202us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1573883264}
I20260807 13:38:55.283151 23479 raft_consensus.cc:2454] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:55.257246 23737 ts_tablet_manager.cc:1428] T 356c6b3e51454d418acaa9be70bb9689 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.447s user 0.013s sys 0.001s
I20260807 13:38:55.287153 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:55.259529 23739 ts_tablet_manager.cc:1397] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.943s user 0.044s sys 0.004s
I20260807 13:38:55.203609 23574 rpcz_store.cc:276] 0807 13:38:53.198778 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.906842 (+1708064us) service_pool.cc:227] Handling call
0807 13:38:54.994960 (+ 88118us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:55.022152 (+ 27192us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:55.025326 (+ 3174us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:55.030675 (+ 5349us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:38:55.032298 (+ 1623us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:55.048082 (+ 15784us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:55.077980 (+ 29898us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15938,"raft.queue_time_us":22415,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":11863}
I20260807 13:38:55.277391 24881 raft_consensus.cc:3037] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:55.295961 23533 leader_election.cc:302] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:55.272490 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:55.260465 24740 raft_consensus.cc:504] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.304121 24840 raft_consensus.cc:3037] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:55.312178 23573 raft_consensus.cc:2379] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 5: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:55.288525 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:55.303190 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:55.268445 23471 rpcz_store.cc:276] 0807 13:38:54.087163 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.095714 (+ 8551us) service_pool.cc:227] Handling call
0807 13:38:55.267978 (+1172264us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:55.302929 23575 raft_consensus.cc:2454] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:55.284375 23473 raft_consensus.cc:2454] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4.
W20260807 13:38:55.253539 23578 rpcz_store.cc:269] 0807 13:38:53.223579 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:53.261802 (+ 38223us) service_pool.cc:227] Handling call
0807 13:38:53.973456 (+711654us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:55.218496 (+1245040us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6572928}
I20260807 13:38:55.288542 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:55.287166 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:55.312721 23573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 299) took 2213 ms (client timeout 2755 ms). Trace:
I20260807 13:38:55.316680 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:55.308132 24417 leader_election.cc:288] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:55.297894 24732 raft_consensus.cc:2781] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:38:55.288740 24845 raft_consensus.cc:504] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.301326 24962 leader_election.cc:288] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:55.308252 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:55.298730 24507 raft_consensus.cc:504] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.336714 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:55.316008 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:55.304659 24946 raft_consensus.cc:504] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.336336 24965 consensus_queue.cc:237] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.337749 23633 leader_election.cc:302] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:55.642318 23740 tablet_bootstrap.cc:492] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:38:55.658419 23739 raft_consensus.cc:348] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.662199 23739 raft_consensus.cc:374] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:55.662725 23739 raft_consensus.cc:729] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:55.656876 23481 raft_consensus.cc:2454] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:55.669191 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:55.661981 23740 ts_tablet_manager.cc:1397] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 1.376s user 0.062s sys 0.031s
W20260807 13:38:55.685645 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 347954us
I20260807 13:38:55.371873 23469 raft_consensus.cc:2379] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 5: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:55.340229 23473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 296) took 1360 ms. Trace:
I20260807 13:38:55.720279 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:55.578845 24898 leader_election.cc:288] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:55.663520 23739 consensus_queue.cc:260] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.337314 24908 raft_consensus.cc:2781] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:55.601825 24806 raft_consensus.cc:482] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:55.623056 24981 log.cc:924] Time spent T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.164s user 0.000s sys 0.001s
I20260807 13:38:55.336405 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:55.718595 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:55.336871 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:55.624538 24977 log.cc:924] Time spent T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.284s user 0.001s sys 0.000s
I20260807 13:38:55.386372 24948 raft_consensus.cc:482] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:55.488333 24873 raft_consensus.cc:482] T 356c6b3e51454d418acaa9be70bb9689 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:55.323594 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:55.573100 24519 leader_election.cc:288] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:55.723843 23674 raft_consensus.cc:2454] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 5.
I20260807 13:38:55.457207 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:55.673542 23571 raft_consensus.cc:3037] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:55.372159 23672 raft_consensus.cc:2454] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
I20260807 13:38:55.372864 24856 leader_election.cc:288] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:55.731884 23737 tablet_bootstrap.cc:492] T 4996c3c52ccc41b9a8da11ca747a8e6a P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:55.732096 23739 ts_tablet_manager.cc:1428] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.430s user 0.014s sys 0.001s
I20260807 13:38:55.713914 24732 raft_consensus.cc:686] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:55.724185 24962 raft_consensus.cc:2781] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:55.713176 24740 leader_election.cc:288] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:55.735347 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:55.720849 24844 raft_consensus.cc:482] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:55.673539 23578 raft_consensus.cc:2454] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4.
I20260807 13:38:55.634666 24953 raft_consensus.cc:504] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.723485 23473 rpcz_store.cc:276] 0807 13:38:53.980272 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.145483 (+165211us) service_pool.cc:227] Handling call
0807 13:38:55.340142 (+1194659us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":35456}
I20260807 13:38:55.737900 23575 raft_consensus.cc:2454] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:38:55.440740 24944 raft_consensus.cc:504] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.619712 24840 raft_consensus.cc:504] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.578711 24932 raft_consensus.cc:504] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.569195 24652 raft_consensus.cc:504] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:55.660024 23573 rpcz_store.cc:269] 0807 13:38:53.099399 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.056523 (+957124us) service_pool.cc:227] Handling call
0807 13:38:55.263053 (+1206530us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:55.312647 (+ 49594us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6986496}
W20260807 13:38:55.745247 23674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57122 (request call id 424) took 1648 ms (client timeout 1754 ms). Trace:
I20260807 13:38:55.750946 23533 leader_election.cc:302] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:55.741199 24948 raft_consensus.cc:504] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.731904 24806 raft_consensus.cc:504] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.745554 24962 raft_consensus.cc:482] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:55.754231 23633 leader_election.cc:302] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:55.760288 23671 raft_consensus.cc:1226] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
W20260807 13:38:55.764757 23631 leader_election.cc:334] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 1.531s (SENT)
I20260807 13:38:55.773054 23679 raft_consensus.cc:2379] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:55.761170 24953 leader_election.cc:288] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:55.764997 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:55.749166 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:55.780426 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39707c5d97164544b9f5c03db41181c0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:55.741369 24873 raft_consensus.cc:504] T 356c6b3e51454d418acaa9be70bb9689 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.774700 23633 leader_election.cc:302] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:55.775470 24943 raft_consensus.cc:2781] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:38:55.776041 23582 raft_consensus.cc:2379] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 5: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:55.772049 24740 raft_consensus.cc:2781] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:38:55.750697 24844 raft_consensus.cc:504] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.778718 23581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 305) took 2515 ms. Trace:
W20260807 13:38:55.769714 23674 rpcz_store.cc:269] 0807 13:38:54.095497 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.099257 (+ 3760us) service_pool.cc:227] Handling call
0807 13:38:55.673551 (+1574294us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b5800004298. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ffb7c 00007fc6950ff73b 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:55.743938 (+ 70387us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":10482688}
I20260807 13:38:55.780377 23577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 304) took 2552 ms. Trace:
I20260807 13:38:55.752992 24881 raft_consensus.cc:504] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.774284 24962 raft_consensus.cc:3037] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:55.785938 24953 raft_consensus.cc:2781] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:55.800343 24844 leader_election.cc:288] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:55.796564 23577 rpcz_store.cc:276] 0807 13:38:53.228094 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:55.011365 (+1783271us) service_pool.cc:227] Handling call
0807 13:38:55.097920 (+ 86555us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:55.214109 (+116189us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:55.780184 (+566075us) spinlock_profiling.cc:243] Waited 49.6 ms on lock 0x7b540024ead0. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ea09 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:55.780313 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":114027392}
I20260807 13:38:55.802600 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:55.769683 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:55.783371 24943 raft_consensus.cc:482] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:55.803598 24943 raft_consensus.cc:3037] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:55.804263 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:55.804950 23674 raft_consensus.cc:3037] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:55.792155 24740 raft_consensus.cc:482] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:55.807519 24962 raft_consensus.cc:504] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:55.785250 24907 consensus_meta.cc:287] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.522s user 0.013s sys 0.000s
W20260807 13:38:55.808372 23631 leader_election.cc:334] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 1.571s (SENT)
I20260807 13:38:55.798789 24953 raft_consensus.cc:482] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:55.808135 24740 raft_consensus.cc:3037] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:55.808889 23631 leader_election.cc:302] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:55.794644 23581 rpcz_store.cc:276] 0807 13:38:53.263486 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:55.223752 (+1960266us) service_pool.cc:227] Handling call
0807 13:38:55.224208 (+ 456us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:55.236797 (+ 12589us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:38:55.254011 (+ 17214us) log.cc:842] Serialized 14 byte log entry
0807 13:38:55.289823 (+ 35812us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:55.298277 (+ 8454us) log.cc:842] Serialized 26 byte log entry
0807 13:38:55.303097 (+ 4820us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:55.303136 (+ 39us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:55.303202 (+ 66us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:55.778541 (+475339us) raft_consensus.cc:1671] finished
0807 13:38:55.778560 (+ 19us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:55.778670 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12017,"prepare.queue_time_us":15232,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":12317,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":17438,"thread_start_us":19829,"threads_started":1,"wal-append.queue_time_us":54282}
I20260807 13:38:55.777016 23676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 422) took 1680 ms. Trace:
I20260807 13:38:55.812076 24885 raft_consensus.cc:3032] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:38:55.826040 24652 leader_election.cc:288] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:55.826297 24885 raft_consensus.cc:729] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:55.815431 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:55.815985 24844 consensus_queue.cc:1035] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:38:55.816315 24908 raft_consensus.cc:482] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:55.814210 24953 raft_consensus.cc:3037] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:55.816493 24856 raft_consensus.cc:2726] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:55.778259 24732 consensus_queue.cc:237] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.817729 23672 raft_consensus.cc:2379] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 5: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:55.818181 24944 leader_election.cc:288] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:55.795295 24946 leader_election.cc:288] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:55.820111 24819 raft_consensus.cc:482] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:55.820549 24881 leader_election.cc:288] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:55.822211 24507 leader_election.cc:288] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:55.795818 24845 leader_election.cc:288] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:55.781244 23473 raft_consensus.cc:2362] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1. Re-sending same reply.
I20260807 13:38:55.781908 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:55.803603 23577 raft_consensus.cc:2379] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 5: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:55.825429 23572 raft_consensus.cc:2454] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:38:55.827818 23581 raft_consensus.cc:2454] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:55.785213 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:55.796079 24932 leader_election.cc:288] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:55.831919 24908 raft_consensus.cc:3037] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:55.833244 23674 raft_consensus.cc:2454] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:55.835258 24885 consensus_queue.cc:260] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.841957 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:55.842836 23739 tablet_bootstrap.cc:492] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:55.854516 23470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 290) took 1877 ms. Trace:
I20260807 13:38:55.860255 23737 tablet_bootstrap.cc:654] T 4996c3c52ccc41b9a8da11ca747a8e6a P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:55.843343 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b078a19f38494b04ad11b14d98ec4bca" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:55.861028 23532 leader_election.cc:334] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 1.532s (SENT)
W20260807 13:38:55.994724 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 133753us
I20260807 13:38:55.995301 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:55.996236 23581 raft_consensus.cc:3037] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:55.997340 23633 leader_election.cc:302] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
W20260807 13:38:56.013527 23532 leader_election.cc:334] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 1.592s (SENT)
I20260807 13:38:56.014321 23532 leader_election.cc:302] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:56.034582 23740 raft_consensus.cc:348] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:56.035661 23740 raft_consensus.cc:374] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:56.036047 23740 raft_consensus.cc:729] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:38:55.871351 24881 raft_consensus.cc:482] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:56.036934 23740 consensus_queue.cc:260] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:55.931469 24519 raft_consensus.cc:482] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:55.931758 24417 raft_consensus.cc:482] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:55.924266 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:55.867568 24873 leader_election.cc:288] T 356c6b3e51454d418acaa9be70bb9689 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:55.922518 23578 raft_consensus.cc:3037] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:56.045238 23740 ts_tablet_manager.cc:1428] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1: Time spent starting tablet: real 0.327s user 0.004s sys 0.004s
I20260807 13:38:56.022106 24806 leader_election.cc:288] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:55.928602 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:55.926059 24647 raft_consensus.cc:482] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:55.921185 24507 raft_consensus.cc:482] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:56.033514 24830 raft_consensus.cc:2781] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:55.966113 23574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 306) took 2685 ms. Trace:
I20260807 13:38:55.922272 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "356c6b3e51454d418acaa9be70bb9689" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:56.050902 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:55.926940 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6ae70649fa43bba8052b66977418f5" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:55.920708 23571 raft_consensus.cc:2454] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 5.
I20260807 13:38:56.049182 24519 raft_consensus.cc:504] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:56.057682 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cd369f3fbdf4b61a5fd1e85690c9ba4" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:55.848953 24819 raft_consensus.cc:504] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:56.051988 24417 raft_consensus.cc:504] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:56.042052 24885 raft_consensus.cc:3037] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:38:56.024551 23572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 310) took 2511 ms (client timeout 3106 ms). Trace:
I20260807 13:38:56.057104 24434 raft_consensus.cc:482] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
W20260807 13:38:56.101377 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 75086.1us
I20260807 13:38:56.102090 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 410) took 2877 ms. Trace:
I20260807 13:38:56.045704 24932 raft_consensus.cc:2726] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 13:38:56.057166 24863 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.743s user 0.027s sys 0.035s
I20260807 13:38:56.171290 23684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57116 (request call id 452) took 1346 ms. Trace:
I20260807 13:38:56.160815 23581 raft_consensus.cc:2454] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:38:56.033504 23478 raft_consensus.cc:2454] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
W20260807 13:38:56.168548 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 228118us
I20260807 13:38:56.111822 24507 raft_consensus.cc:504] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:56.050031 24840 leader_election.cc:288] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:56.047978 24881 raft_consensus.cc:504] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:56.090859 24962 leader_election.cc:288] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:56.086891 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:56.325135 23344 rpcz_store.cc:267] Call kudu.master.MasterService.IsCreateTableDone from 127.0.0.1:41396 (request call id 43) took 2121 ms (client timeout 2473 ms). Trace:
I20260807 13:38:56.206453 23633 leader_election.cc:302] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:56.324779 23679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57116 (request call id 448) took 1511 ms. Trace:
W20260807 13:38:56.696393 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 490022us
I20260807 13:38:56.618189 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:56.696586 23679 rpcz_store.cc:276] 0807 13:38:54.813751 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:55.223064 (+409313us) service_pool.cc:227] Handling call
0807 13:38:56.324528 (+1101464us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b5400041354. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:56.324696 (+ 168us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1262190976}
I20260807 13:38:56.697279 23481 raft_consensus.cc:2454] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:56.697866 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 474) took 1429 ms. Trace:
I20260807 13:38:55.828392 23676 rpcz_store.cc:276] 0807 13:38:54.094832 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.099062 (+ 4230us) service_pool.cc:227] Handling call
0807 13:38:55.285924 (+1186862us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b5800004298. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:38:55.297860 (+ 11936us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:55.337740 (+ 39880us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:55.372573 (+ 34833us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:55.514767 (+142194us) log.cc:842] Serialized 26 byte log entry
0807 13:38:55.719999 (+205232us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:55.720497 (+ 498us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:55.729494 (+ 8997us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:55.762019 (+ 32525us) raft_consensus.cc:1671] finished
0807 13:38:55.764106 (+ 2087us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:55.774923 (+ 10817us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":38595,"raft.queue_time_us":10190,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":35011,"spinlock_wait_cycles":9773824,"thread_start_us":140025,"threads_started":1,"wal-append.queue_time_us":167996}
I20260807 13:38:56.115118 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:56.700299 23346 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41376 (request call id 64) took 7993 ms. Trace:
W20260807 13:38:56.174763 23532 leader_election.cc:334] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 1.667s (SENT)
I20260807 13:38:56.698236 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:56.104369 24647 raft_consensus.cc:3037] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:56.169078 24873 raft_consensus.cc:482] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:56.698195 23481 rpcz_store.cc:276] 0807 13:38:55.268226 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:55.746858 (+478632us) service_pool.cc:227] Handling call
0807 13:38:56.617940 (+871082us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b5800003398. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:56.697803 (+ 79863us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5141248}
I20260807 13:38:56.206489 23473 raft_consensus.cc:2379] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 5: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:56.107199 24948 leader_election.cc:288] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:56.106673 24830 raft_consensus.cc:482] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:56.266599 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a3da79d3b0447cbc19c4f28279e134" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:56.774564 23533 leader_election.cc:302] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:56.326571 24963 leader_election.cc:288] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:56.770231 24945 raft_consensus.cc:482] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:56.710283 24345 raft_consensus.cc:482] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:56.385259 24931 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.163s user 0.034s sys 0.076s
I20260807 13:38:56.106554 23672 raft_consensus.cc:3037] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:56.765743 24732 raft_consensus.cc:2781] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:38:56.785842 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:56.826663 23631 leader_election.cc:302] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:56.827376 23481 raft_consensus.cc:2379] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 5: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:56.502727 24857 leader_election.cc:288] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
W20260807 13:38:56.667424 24908 consensus_meta.cc:287] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.634s user 0.009s sys 0.001s
I20260807 13:38:56.304250 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:56.425069 23680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 435) took 2107 ms. Trace:
I20260807 13:38:56.364965 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:56.712436 24519 leader_election.cc:288] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:56.266685 24953 raft_consensus.cc:504] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:56.769322 23684 rpcz_store.cc:276] 0807 13:38:54.824978 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:55.285879 (+460901us) service_pool.cc:227] Handling call
0807 13:38:56.050665 (+764786us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b5800004298. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:56.171220 (+120555us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6391680}
I20260807 13:38:56.174947 23580 rpcz_store.cc:276] 0807 13:38:53.224737 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:55.824330 (+2599593us) service_pool.cc:227] Handling call
0807 13:38:55.824710 (+ 380us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:55.825063 (+ 353us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:55.825091 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:55.825562 (+ 471us) log.cc:842] Serialized 26 byte log entry
0807 13:38:56.034665 (+209103us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:38:56.034717 (+ 52us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:56.034810 (+ 93us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:56.101736 (+ 66926us) raft_consensus.cc:1671] finished
0807 13:38:56.101767 (+ 31us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:56.101997 (+ 230us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":82,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":139,"thread_start_us":208735,"threads_started":1,"wal-append.queue_time_us":266317}
I20260807 13:38:56.837832 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:56.838390 23580 raft_consensus.cc:3037] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:56.363394 24903 raft_consensus.cc:3037] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:56.619084 24893 raft_consensus.cc:482] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:56.632903 24805 raft_consensus.cc:482] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:56.817574 24945 raft_consensus.cc:504] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:56.496802 23582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 327) took 1268 ms. Trace:
I20260807 13:38:56.802114 24873 raft_consensus.cc:504] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:56.709811 24417 leader_election.cc:288] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:56.424213 23677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57122 (request call id 434) took 2106 ms (client timeout 1882 ms). Trace:
I20260807 13:38:56.409072 23671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 427) took 2312 ms. Trace:
I20260807 13:38:56.709337 24942 leader_election.cc:288] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
W20260807 13:38:56.460306 23681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57116 (request call id 454) took 1612 ms (client timeout 1864 ms). Trace:
W20260807 13:38:56.847313 23681 rpcz_store.cc:269] 0807 13:38:54.848056 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.997467 (+149411us) service_pool.cc:227] Handling call
0807 13:38:56.460054 (+1462587us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b540035acd4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:56.460222 (+ 168us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":331949440}
I20260807 13:38:56.324946 24819 leader_election.cc:288] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
W20260807 13:38:56.211779 24869 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.388s user 0.001s sys 0.020s
W20260807 13:38:56.306567 24943 consensus_meta.cc:287] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.502s user 0.007s sys 0.004s
W20260807 13:38:56.207726 24863 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.894s user 0.028s sys 0.035s
W20260807 13:38:56.260676 24984 log.cc:924] Time spent T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.087s user 0.000s sys 0.000s
I20260807 13:38:56.695504 24434 raft_consensus.cc:3037] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:56.806754 24830 raft_consensus.cc:3037] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:56.834297 24908 raft_consensus.cc:504] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:56.850005 24869 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 2.062s user 0.004s sys 0.033s
I20260807 13:38:56.842489 24893 raft_consensus.cc:504] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:56.851033 24943 raft_consensus.cc:504] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:56.859449 24953 leader_election.cc:288] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:56.860280 24943 leader_election.cc:288] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:56.859702 24893 leader_election.cc:288] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:56.860977 24945 leader_election.cc:288] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:56.862485 24908 leader_election.cc:288] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
F20260807 13:38:56.644411 21780 test_workload.cc:378] Timed out: Timed out waiting for Table Creation
W20260807 13:38:56.695711 23344 rpcz_store.cc:269] 0807 13:38:54.215780 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.218412 (+ 2632us) service_pool.cc:227] Handling call
0807 13:38:56.314965 (+2096553us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b5400002dd4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4af0 00007fc698067f2a 00007fc69dfb9d6c 00007fc69e0b52c6 00007fc69c3cf5b4 00007fc69c3cf542 00007fc69c3cf471 00007fc69c3cf3ec 00007fc69c3ce6a2 00007fc69648994c 00007fc696488d86
0807 13:38:56.315163 (+ 198us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0807 13:38:56.315415 (+ 252us) catalog_manager.cc:2245] Verify if the table creation is in progress for test-workload [id=6c3159b450c749628fd57db2251c593c]
0807 13:38:56.316522 (+ 1107us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1478389120}
*** Check failure stack trace: ***
W20260807 13:38:56.898223 23430 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:33986 dropped due to backpressure. The service queue is full; it has 50 items.
I20260807 13:38:55.993996 23470 rpcz_store.cc:276] 0807 13:38:53.977096 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.202263 (+225167us) service_pool.cc:227] Handling call
0807 13:38:54.202544 (+ 281us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:54.318833 (+116289us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:54.325599 (+ 6766us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:54.352253 (+ 26654us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:54.355751 (+ 3498us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:55.854179 (+1498428us) spinlock_profiling.cc:243] Waited 86.6 ms on lock 0x7b54001e23d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:55.854236 (+ 57us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:55.854437 (+ 201us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":199291136}
*** Aborted at 1786109936 (unix time) try "date -d @1786109936" if you are using GNU date ***
I20260807 13:38:56.971747 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:56.815169 23471 raft_consensus.cc:2454] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:56.974460 23471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 483) took 1049 ms. Trace:
I20260807 13:38:56.226953 23475 raft_consensus.cc:2454] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:56.970907 23430 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:33986 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 343)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 471)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 333)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 342)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 340)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 332)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 339)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 480)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 493)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 464)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 494)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 322)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 330)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 497)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 485)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 481)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 499)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 500)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 338)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 491)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 341)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 336)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 337)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 454)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 460)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 461)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 466)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 467)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 318)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 319)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 320)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 325)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 326)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 327)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 328)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 329)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 478)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 331)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 334)
I20260807 13:38:56.901190 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:56.901152 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:56.975967 23475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 486) took 1048 ms. Trace:
I20260807 13:38:56.483207 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:56.775053 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:56.978896 24903 consensus_queue.cc:1046] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:38:56.975272 24830 raft_consensus.cc:504] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:56.979851 23472 raft_consensus.cc:2454] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
I20260807 13:38:56.980703 23472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 484) took 1054 ms. Trace:
W20260807 13:38:56.978957 23469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 468) took 1713 ms (client timeout 2203 ms). Trace:
W20260807 13:38:56.456265 23479 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 309) took 2135 ms (client timeout 2806 ms). Trace:
I20260807 13:38:56.817755 23571 raft_consensus.cc:3037] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:38:56.982123 23479 rpcz_store.cc:269] 0807 13:38:54.320656 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.876963 (+556307us) service_pool.cc:227] Handling call
0807 13:38:56.456003 (+1579040us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b5400340154. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:56.456176 (+ 173us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":880700672}
W20260807 13:38:56.816277 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 46265.7us
I20260807 13:38:56.983865 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:56.985106 23479 raft_consensus.cc:2396] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:38:56.816817 23532 leader_election.cc:302] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:56.986168 23533 leader_election.cc:302] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:56.172079 23574 rpcz_store.cc:276] 0807 13:38:53.266687 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:55.769531 (+2502844us) service_pool.cc:227] Handling call
0807 13:38:55.810176 (+ 40645us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:55.830324 (+ 20148us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:55.833771 (+ 3447us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:55.837927 (+ 4156us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:55.849642 (+ 11715us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:55.856031 (+ 6389us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:55.951774 (+ 95743us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:56.987305 24830 leader_election.cc:288] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
W20260807 13:38:56.987728 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 812782us
W20260807 13:38:56.173712 23572 rpcz_store.cc:269] 0807 13:38:53.513230 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:55.335983 (+1822753us) service_pool.cc:227] Handling call
0807 13:38:56.005625 (+669642us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:56.989019 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9fcdd060ef64874a8719c95b2325942" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:56.990541 23574 raft_consensus.cc:3037] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:56.429916 23573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 311) took 2767 ms. Trace:
I20260807 13:38:56.991253 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:56.992475 23572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 343) took 1199 ms. Trace:
I20260807 13:38:56.992072 23573 rpcz_store.cc:276] 0807 13:38:53.662614 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:55.774218 (+2111604us) service_pool.cc:227] Handling call
0807 13:38:56.428974 (+654756us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:38:56.429262 (+ 288us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:56.429510 (+ 248us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:56.429556 (+ 46us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:56.429614 (+ 58us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:56.429646 (+ 32us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:56.429704 (+ 58us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:56.429838 (+ 134us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4302080}
I20260807 13:38:56.904798 23577 raft_consensus.cc:2379] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 3: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:56.994876 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:56.326069 23578 raft_consensus.cc:2454] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 5.
I20260807 13:38:56.997171 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:56.998273 23578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 335) took 1277 ms. Trace:
I20260807 13:38:56.998799 23578 rpcz_store.cc:276] 0807 13:38:55.720484 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:55.757479 (+ 36995us) service_pool.cc:227] Handling call
0807 13:38:56.998033 (+1240554us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:56.908569 23575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 325) took 1680 ms. Trace:
I20260807 13:38:56.804378 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:57.004256 25001 raft_consensus.cc:3032] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:38:57.004492 23581 raft_consensus.cc:2454] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:56.999815 23575 rpcz_store.cc:276] 0807 13:38:55.227901 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:55.763624 (+535723us) service_pool.cc:227] Handling call
0807 13:38:56.364778 (+601154us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ffbce 000000000034aea9 00007fc69cf2ba30 00007fc69cff17b4 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:56.908261 (+543483us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2894592}
I20260807 13:38:57.004856 25001 raft_consensus.cc:729] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:57.006670 23581 raft_consensus.cc:1261] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:56.842665 23582 rpcz_store.cc:276] 0807 13:38:55.228485 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:55.284567 (+ 56082us) service_pool.cc:227] Handling call
0807 13:38:56.493152 (+1208585us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b540030bbd4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:56.496706 (+ 3554us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":71640320}
I20260807 13:38:56.842840 23633 leader_election.cc:302] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:56.843180 23631 leader_election.cc:302] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:57.013445 24830 raft_consensus.cc:2781] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:57.015470 24830 raft_consensus.cc:686] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
W20260807 13:38:57.016388 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 173112us
I20260807 13:38:57.011155 23581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 329) took 1772 ms. Trace:
I20260807 13:38:57.017261 24830 consensus_queue.cc:237] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:57.018317 23577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 319) took 2705 ms. Trace:
I20260807 13:38:56.926847 23674 raft_consensus.cc:3037] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:56.847123 23671 rpcz_store.cc:276] 0807 13:38:54.097108 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.104107 (+ 6999us) service_pool.cc:227] Handling call
0807 13:38:55.244311 (+1140204us) spinlock_profiling.cc:243] Waited 6.13 ms on lock 0x7b5800004298. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ffbce 000000000034aea9 00007fc69cf2ba30 00007fc69cff17b4 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:38:55.244488 (+ 177us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:55.775177 (+530689us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:56.408643 (+633466us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b540035b6d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:56.408974 (+ 331us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1183002112}
I20260807 13:38:57.020087 24869 raft_consensus.cc:2726] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:38:57.020675 24908 raft_consensus.cc:2781] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:38:57.021145 24908 raft_consensus.cc:482] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:57.021713 24908 raft_consensus.cc:3037] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Advancing to term 5
W20260807 13:38:56.845541 23677 rpcz_store.cc:269] 0807 13:38:54.317700 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.348910 (+ 31210us) service_pool.cc:227] Handling call
0807 13:38:56.423882 (+2074972us) spinlock_profiling.cc:243] Waited 81.4 ms on lock 0x7b540016fb54. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:56.424097 (+ 215us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":187236608}
I20260807 13:38:57.025233 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:57.018829 23577 rpcz_store.cc:276] 0807 13:38:54.312754 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:56.998721 (+2685967us) service_pool.cc:227] Handling call
0807 13:38:56.999393 (+ 672us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:57.017471 (+ 18078us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:57.017537 (+ 66us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:57.017633 (+ 96us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:57.017678 (+ 45us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.017750 (+ 72us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:57.018217 (+ 467us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:56.832602 23680 rpcz_store.cc:276] 0807 13:38:54.318016 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.318508 (+ 492us) service_pool.cc:227] Handling call
0807 13:38:54.318871 (+ 363us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:54.410498 (+ 91627us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:54.410543 (+ 45us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:54.411036 (+ 493us) log.cc:842] Serialized 26 byte log entry
0807 13:38:54.744513 (+333477us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:54.744572 (+ 59us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:56.424546 (+1679974us) spinlock_profiling.cc:243] Waited 91.2 ms on lock 0x7b540041bc54. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:56.424609 (+ 63us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:56.424676 (+ 67us) raft_consensus.cc:1671] finished
0807 13:38:56.424694 (+ 18us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:56.425002 (+ 308us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":4059,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":9415,"spinlock_wait_cycles":209736960,"thread_start_us":267749,"threads_started":1,"wal-append.queue_time_us":463044,"wal-append.run_cpu_time_us":1999,"wal-append.run_wall_time_us":1035178}
I20260807 13:38:56.845578 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:56.843762 23737 tablet_bootstrap.cc:492] T 4996c3c52ccc41b9a8da11ca747a8e6a P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:56.929312 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e552e0aa3f4433858116fa31ee8458" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:56.933676 23739 tablet_bootstrap.cc:654] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:56.825491 24345 raft_consensus.cc:504] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:56.785004 24652 raft_consensus.cc:482] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
W20260807 13:38:57.039428 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 71534.4us
I20260807 13:38:57.039789 24652 raft_consensus.cc:504] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:57.040575 23429 leader_election.cc:302] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:57.041654 24345 leader_election.cc:288] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:57.041877 23429 leader_election.cc:302] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:57.042397 24345 raft_consensus.cc:2781] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:56.823812 24948 raft_consensus.cc:2781] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:56.831130 24962 raft_consensus.cc:2726] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260807 13:38:56.825203 24931 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.609s user 0.034s sys 0.090s
I20260807 13:38:56.265201 24740 raft_consensus.cc:504] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:56.835706 24732 raft_consensus.cc:686] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:56.937484 24507 leader_election.cc:288] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:56.940622 24863 raft_consensus.cc:482] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:56.857293 24873 leader_election.cc:288] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
W20260807 13:38:56.945225 23407 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:38:56.947564 23672 raft_consensus.cc:2454] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 5.
I20260807 13:38:56.958544 24881 leader_election.cc:288] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:56.962720 23480 raft_consensus.cc:2454] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:56.824508 23478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 313) took 1881 ms. Trace:
I20260807 13:38:57.058195 24732 consensus_queue.cc:237] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:57.059389 24740 leader_election.cc:288] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:56.974994 23471 rpcz_store.cc:276] 0807 13:38:55.925500 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:56.049691 (+124191us) service_pool.cc:227] Handling call
0807 13:38:56.974189 (+924498us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:56.976586 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 470) took 1709 ms. Trace:
I20260807 13:38:56.981133 23472 rpcz_store.cc:276] 0807 13:38:55.926035 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:56.694710 (+768675us) service_pool.cc:227] Handling call
0807 13:38:56.980574 (+285864us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:56.993048 23572 rpcz_store.cc:276] 0807 13:38:55.793056 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:56.990618 (+1197562us) service_pool.cc:227] Handling call
0807 13:38:56.992376 (+ 1758us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:56.891897 23346 rpcz_store.cc:276] 0807 13:38:48.711898 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:48.715796 (+ 3898us) service_pool.cc:227] Handling call
0807 13:38:56.700201 (+7984405us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:38:53.997784 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:38:53.998345 (+ 561us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:38:53.998386 (+ 41us) write_op.cc:435] Acquired schema lock
0807 13:38:53.998409 (+ 23us) tablet.cc:660] Decoding operations
0807 13:38:53.999622 (+ 1213us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:38:54.017420 (+ 17798us) write_op.cc:641] Partition lock acquired for write op
0807 13:38:54.018434 (+ 1014us) tablet.cc:683] Acquiring locks for 12 operations
0807 13:38:54.155300 (+136866us) tablet.cc:699] Row locks acquired
0807 13:38:54.155327 (+ 27us) write_op.cc:260] PREPARE: finished
0807 13:38:54.155487 (+ 160us) write_op.cc:270] Start()
0807 13:38:54.155610 (+ 123us) write_op.cc:276] Timestamp: P: 1786109934155444 usec, L: 0
0807 13:38:54.155630 (+ 20us) op_driver.cc:331] REPLICATION: starting
0807 13:38:54.213616 (+ 57986us) log.cc:842] Serialized 4733 byte log entry
0807 13:38:55.127436 (+913820us) op_driver.cc:444] REPLICATION: finished
0807 13:38:55.295622 (+168186us) write_op.cc:301] APPLY: starting
0807 13:38:55.301636 (+ 6014us) tablet.cc:1365] starting BulkCheckPresence
0807 13:38:55.586640 (+285004us) tablet.cc:1368] finished BulkCheckPresence
0807 13:38:55.590644 (+ 4004us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:38:55.592456 (+ 1812us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:38:55.592791 (+ 335us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0807 13:38:55.592864 (+ 73us) write_op.cc:312] APPLY: finished
0807 13:38:55.593333 (+ 469us) log.cc:842] Serialized 88 byte log entry
0807 13:38:55.612695 (+ 19362us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:38:55.612873 (+ 178us) write_op.cc:454] Released schema lock
0807 13:38:55.612925 (+ 52us) write_op.cc:341] FINISH: Updating metrics
0807 13:38:55.613206 (+ 281us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:38:55.613231 (+ 25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":168209,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":111899,"apply.run_cpu_time_us":5483,"apply.run_wall_time_us":320654,"num_ops":12,"prepare.queue_time_us":376731,"prepare.run_cpu_time_us":33597,"prepare.run_wall_time_us":863980,"raft.queue_time_us":184255,"raft.run_cpu_time_us":5495,"raft.run_wall_time_us":155825,"replication_time_us":965666,"thread_start_us":1187466,"threads_started":4,"wal-append.queue_time_us":642751,"wal-append.run_cpu_time_us":51366,"wal-append.run_wall_time_us":1751809}]]}
I20260807 13:38:57.060360 23481 rpcz_store.cc:276] 0807 13:38:55.266947 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:56.900279 (+1633332us) service_pool.cc:227] Handling call
0807 13:38:56.976524 (+ 76245us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.064790 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:56.985607 23479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 471) took 1718 ms. Trace:
I20260807 13:38:57.065555 23479 rpcz_store.cc:276] 0807 13:38:55.267210 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:56.983377 (+1716167us) service_pool.cc:227] Handling call
0807 13:38:56.985545 (+ 2168us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.063079 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:57.066021 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e552e0aa3f4433858116fa31ee8458" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:57.066785 23471 raft_consensus.cc:3037] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:57.066874 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a3da79d3b0447cbc19c4f28279e134" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:57.067009 23472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 473) took 1799 ms. Trace:
I20260807 13:38:57.062235 23573 raft_consensus.cc:2396] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260807 13:38:56.976560 23475 rpcz_store.cc:276] 0807 13:38:55.927540 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:56.051681 (+124141us) service_pool.cc:227] Handling call
0807 13:38:56.975721 (+924040us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.067516 23472 rpcz_store.cc:276] 0807 13:38:55.267886 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.065602 (+1797716us) service_pool.cc:227] Handling call
0807 13:38:57.066929 (+ 1327us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.070628 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:57.070770 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:57.071811 23475 raft_consensus.cc:2379] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:57.072546 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:57.072959 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:57.073498 23472 raft_consensus.cc:2454] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:57.047857 24948 raft_consensus.cc:686] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
W20260807 13:38:57.012718 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 169838us
I20260807 13:38:57.012110 24434 raft_consensus.cc:504] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:56.976398 23473 raft_consensus.cc:3037] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:38:56.282573 23675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57122 (request call id 423) took 2187 ms (client timeout 1717 ms). Trace:
I20260807 13:38:57.021023 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:57.087026 23675 rpcz_store.cc:269] 0807 13:38:54.095177 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.099103 (+ 3926us) service_pool.cc:227] Handling call
0807 13:38:55.052052 (+952949us) spinlock_profiling.cc:243] Waited 5.32 ms on lock 0x7b5800004298. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ffbce 000000000034aea9 00007fc69cf2ba30 00007fc69cff17b4 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:56.282312 (+1230260us) spinlock_profiling.cc:243] Waited 80.6 ms on lock 0x7b5400344ed4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:56.282479 (+ 167us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":197674624}
I20260807 13:38:57.087810 23671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57116 (request call id 453) took 2244 ms. Trace:
I20260807 13:38:57.088289 23671 rpcz_store.cc:276] 0807 13:38:54.843241 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.020441 (+2177200us) service_pool.cc:227] Handling call
0807 13:38:57.087705 (+ 67264us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.089012 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:57.089613 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:57.090958 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:56.812294 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:57.092586 23676 raft_consensus.cc:2454] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:57.093499 23676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57116 (request call id 475) took 1270 ms. Trace:
I20260807 13:38:57.094053 23676 rpcz_store.cc:276] 0807 13:38:55.823097 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:56.806176 (+983079us) service_pool.cc:227] Handling call
0807 13:38:57.093345 (+287169us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:56.815691 23679 raft_consensus.cc:2379] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 4: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:57.027592 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9fcdd060ef64874a8719c95b2325942" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:57.103919 23679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57116 (request call id 443) took 2291 ms (client timeout 2873 ms). Trace:
I20260807 13:38:57.104377 23677 raft_consensus.cc:2379] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 2: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
W20260807 13:38:57.104521 23679 rpcz_store.cc:269] 0807 13:38:54.812381 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:56.697837 (+1885456us) service_pool.cc:227] Handling call
0807 13:38:57.103611 (+405774us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.105628 23677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57116 (request call id 468) took 1531 ms. Trace:
I20260807 13:38:57.106212 23677 rpcz_store.cc:276] 0807 13:38:55.573927 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.027076 (+1453149us) service_pool.cc:227] Handling call
0807 13:38:57.105498 (+ 78422us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.028774 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:57.020129 24893 raft_consensus.cc:2726] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260807 13:38:56.981798 23469 rpcz_store.cc:269] 0807 13:38:55.265163 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:55.736789 (+471626us) service_pool.cc:227] Handling call
0807 13:38:56.482950 (+746161us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b5800003398. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:56.978748 (+495798us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4707200}
I20260807 13:38:57.107818 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:57.108428 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:57.108601 23677 raft_consensus.cc:2454] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 5.
I20260807 13:38:57.109258 23469 raft_consensus.cc:2454] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
I20260807 13:38:57.109382 24903 consensus_queue.cc:1046] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:57.109738 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:57.110385 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:57.038110 23684 raft_consensus.cc:2396] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 3 because replica has last-logged OpId of term: 2 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:38:57.017047 23581 rpcz_store.cc:276] 0807 13:38:55.235036 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.005399 (+1770363us) service_pool.cc:227] Handling call
0807 13:38:57.006017 (+ 618us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:57.007193 (+ 1176us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.007499 (+ 306us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.111708 23684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57116 (request call id 461) took 2184 ms. Trace:
I20260807 13:38:57.112268 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:56.842805 24805 raft_consensus.cc:504] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:57.115118 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "356c6b3e51454d418acaa9be70bb9689" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:57.047992 23681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57116 (request call id 445) took 2235 ms. Trace:
I20260807 13:38:57.047823 23631 leader_election.cc:302] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters: 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:57.045629 24345 raft_consensus.cc:482] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:57.075743 25003 raft_consensus.cc:2781] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:38:57.059309 23478 rpcz_store.cc:276] 0807 13:38:54.942915 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:54.947885 (+ 4970us) service_pool.cc:227] Handling call
0807 13:38:55.841766 (+893881us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b5800003398. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ffbce 000000000034aea9 00007fc69cf2ba30 00007fc69cff17b4 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:38:56.821104 (+979338us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":11431808}
I20260807 13:38:57.062211 23672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57116 (request call id 474) took 1269 ms. Trace:
I20260807 13:38:56.922103 23580 raft_consensus.cc:2454] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4.
I20260807 13:38:57.065748 23481 raft_consensus.cc:3037] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:57.006399 25001 consensus_queue.cc:260] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:57.091236 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:57.125079 23672 rpcz_store.cc:276] 0807 13:38:55.792527 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:55.928214 (+135687us) service_pool.cc:227] Handling call
0807 13:38:57.062086 (+1133872us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.131369 25001 raft_consensus.cc:3037] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:57.131664 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:57.134243 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220c24fa0c52459182e1e89c74331f3b" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:57.132081 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:57.136487 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:57.137441 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:57.129580 23533 leader_election.cc:302] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:57.138664 23671 raft_consensus.cc:2379] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 5: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:57.074471 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:57.139618 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:57.140337 23475 raft_consensus.cc:2354] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4.
I20260807 13:38:57.140810 23475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 464) took 1877 ms. Trace:
I20260807 13:38:57.141196 23475 rpcz_store.cc:276] 0807 13:38:55.263177 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.074097 (+1810920us) service_pool.cc:227] Handling call
0807 13:38:57.140739 (+ 66642us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.077090 24948 consensus_queue.cc:237] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:57.085640 23479 raft_consensus.cc:3037] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:38:57.042461 24652 leader_election.cc:288] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:57.115602 24805 leader_election.cc:288] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:57.144898 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:57.112077 23684 rpcz_store.cc:276] 0807 13:38:54.926989 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:56.839861 (+1912872us) service_pool.cc:227] Handling call
0807 13:38:57.111612 (+271751us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.146628 24434 leader_election.cc:288] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:57.147001 23675 raft_consensus.cc:2454] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:38:57.074060 23472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 480) took 1299 ms. Trace:
I20260807 13:38:57.056875 24863 raft_consensus.cc:504] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:57.148942 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
W20260807 13:38:57.120566 23480 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 323) took 1829 ms (client timeout 1793 ms). Trace:
W20260807 13:38:57.156179 23480 rpcz_store.cc:269] 0807 13:38:55.291533 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:55.302928 (+ 11395us) service_pool.cc:227] Handling call
0807 13:38:57.119363 (+1816435us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54001e37d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:57.120462 (+ 1099us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3782559488}
I20260807 13:38:57.120806 24345 raft_consensus.cc:3037] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:38:57.121984 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 74329.5us
I20260807 13:38:57.123252 24873 raft_consensus.cc:2781] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:38:57.118026 23681 rpcz_store.cc:276] 0807 13:38:54.812951 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:56.849838 (+2036887us) service_pool.cc:227] Handling call
0807 13:38:57.047829 (+197991us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.128024 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "608f7e63bc4648e0890e5f601c52736c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:57.129537 23470 raft_consensus.cc:2379] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 1: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:57.130043 23469 raft_consensus.cc:2396] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:38:57.131814 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 347) took 1280 ms. Trace:
I20260807 13:38:57.168332 23580 rpcz_store.cc:276] 0807 13:38:55.851403 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:56.837537 (+986134us) service_pool.cc:227] Handling call
0807 13:38:57.131707 (+294170us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.168924 24873 raft_consensus.cc:686] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:57.169006 23631 leader_election.cc:302] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters: 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:57.169575 23681 raft_consensus.cc:1226] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260807 13:38:57.169486 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:57.170423 23580 raft_consensus.cc:3037] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:57.171952 23469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 322) took 1881 ms. Trace:
I20260807 13:38:57.171900 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:57.172142 24931 consensus_queue.cc:1035] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:57.172557 23469 rpcz_store.cc:276] 0807 13:38:55.290060 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.110036 (+1819976us) service_pool.cc:227] Handling call
0807 13:38:57.171864 (+ 61828us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.172571 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:57.173993 23572 raft_consensus.cc:2454] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:57.174065 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6ae70649fa43bba8052b66977418f5" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:57.157352 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:57.175980 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6ae70649fa43bba8052b66977418f5" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:57.176476 23480 raft_consensus.cc:2379] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 5: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:57.170331 24873 consensus_queue.cc:237] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:57.051769 23737 ts_tablet_manager.cc:1397] T 4996c3c52ccc41b9a8da11ca747a8e6a P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 1.304s user 0.031s sys 0.074s
I20260807 13:38:57.101436 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:57.147071 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faff067df57c4de49e89824bbc248751" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:57.149189 23675 raft_consensus.cc:1226] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 5. Ops: []
I20260807 13:38:57.178898 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:57.131611 23571 raft_consensus.cc:2454] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:57.157266 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:57.149164 23472 rpcz_store.cc:276] 0807 13:38:55.774618 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.072102 (+1297484us) service_pool.cc:227] Handling call
0807 13:38:57.073999 (+ 1897us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.184718 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:57.186368 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:57.173015 23470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 485) took 1246 ms. Trace:
I20260807 13:38:57.179531 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:57.188124 23470 rpcz_store.cc:276] 0807 13:38:55.926504 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.171451 (+1244947us) service_pool.cc:227] Handling call
0807 13:38:57.172923 (+ 1472us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.189039 23469 raft_consensus.cc:2396] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:38:57.189683 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:57.191068 23470 raft_consensus.cc:2379] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 5: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:57.154708 23671 raft_consensus.cc:1226] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 13:38:57.111294 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:57.138743 23633 leader_election.cc:302] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:57.170509 23681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 438) took 2814 ms. Trace:
I20260807 13:38:57.205101 23681 rpcz_store.cc:276] 0807 13:38:54.355962 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.168650 (+2812688us) service_pool.cc:227] Handling call
0807 13:38:57.169207 (+ 557us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:38:57.170123 (+ 916us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.170395 (+ 272us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.171569 24652 raft_consensus.cc:2781] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:38:57.176844 23572 raft_consensus.cc:2454] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:57.118665 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:57.131832 24647 raft_consensus.cc:504] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:57.141314 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:57.217031 23573 raft_consensus.cc:3037] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:57.217649 23582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 332) took 1965 ms. Trace:
I20260807 13:38:57.218264 24647 leader_election.cc:288] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:57.138113 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:57.178901 24805 raft_consensus.cc:2781] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:57.179237 23676 raft_consensus.cc:2379] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 5: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:57.106359 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4996c3c52ccc41b9a8da11ca747a8e6a" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:57.152070 23672 raft_consensus.cc:2396] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
W20260807 13:38:57.180392 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 50937us
I20260807 13:38:57.182806 23571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 346) took 1334 ms. Trace:
I20260807 13:38:57.183037 23480 raft_consensus.cc:2454] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:57.182899 23675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 436) took 2864 ms. Trace:
I20260807 13:38:57.186686 23737 raft_consensus.cc:348] T 4996c3c52ccc41b9a8da11ca747a8e6a P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:57.221313 23737 raft_consensus.cc:374] T 4996c3c52ccc41b9a8da11ca747a8e6a P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:57.221541 23737 raft_consensus.cc:729] T 4996c3c52ccc41b9a8da11ca747a8e6a P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:57.222235 23737 consensus_queue.cc:260] T 4996c3c52ccc41b9a8da11ca747a8e6a P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:57.223148 23679 raft_consensus.cc:2454] T 4996c3c52ccc41b9a8da11ca747a8e6a P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:38:57.124881 25003 raft_consensus.cc:482] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:57.208638 24507 raft_consensus.cc:482] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:57.223963 25003 raft_consensus.cc:3037] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:38:57.224234 23737 ts_tablet_manager.cc:1428] T 4996c3c52ccc41b9a8da11ca747a8e6a P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.047s user 0.008s sys 0.000s
I20260807 13:38:57.224211 24507 raft_consensus.cc:504] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:57.226042 23737 tablet_bootstrap.cc:492] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:57.226270 23679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 442) took 2768 ms. Trace:
I20260807 13:38:57.226917 24507 leader_election.cc:288] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:57.215561 24652 raft_consensus.cc:482] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:57.230834 24652 raft_consensus.cc:3037] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:38:57.234294 23677 raft_consensus.cc:2379] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:57.235984 23677 raft_consensus.cc:1226] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 2. Current term is 3. Ops: []
I20260807 13:38:57.220351 23571 rpcz_store.cc:276] 0807 13:38:55.848323 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:56.227258 (+378935us) service_pool.cc:227] Handling call
0807 13:38:57.180298 (+953040us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:38:57.237367 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 98842.9us
I20260807 13:38:57.226708 23679 rpcz_store.cc:276] 0807 13:38:54.457696 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.225139 (+2767443us) service_pool.cc:227] Handling call
0807 13:38:57.225619 (+ 480us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:57.225961 (+ 342us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:57.225990 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:57.226031 (+ 41us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:57.226059 (+ 28us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.226110 (+ 51us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:57.226214 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.189770 23469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 481) took 1391 ms. Trace:
I20260807 13:38:57.244086 23680 raft_consensus.cc:2379] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:57.187981 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a3da79d3b0447cbc19c4f28279e134" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:57.243999 23671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 437) took 2915 ms. Trace:
I20260807 13:38:57.249832 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:57.237133 23532 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 1.629s (SENT) [suppressed 30 similar messages]
I20260807 13:38:57.236443 24805 raft_consensus.cc:482] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:57.253023 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:57.229058 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9fcdd060ef64874a8719c95b2325942" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:57.256362 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:57.257036 23480 raft_consensus.cc:3037] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:57.249615 24647 raft_consensus.cc:2781] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:57.273206 23572 raft_consensus.cc:2379] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 5: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
W20260807 13:38:57.261030 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 44955.1us
I20260807 13:38:57.256188 23577 raft_consensus.cc:2379] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 3: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:57.275024 23571 raft_consensus.cc:2379] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 5: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:57.278240 23580 raft_consensus.cc:2454] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:38:57.275905 23679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 449) took 2461 ms. Trace:
I20260807 13:38:57.281759 23679 rpcz_store.cc:276] 0807 13:38:54.814036 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.239131 (+2425095us) service_pool.cc:227] Handling call
0807 13:38:57.260414 (+ 21283us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:57.275532 (+ 15118us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.275821 (+ 289us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.250691 23672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57116 (request call id 470) took 1668 ms. Trace:
I20260807 13:38:57.277449 23481 raft_consensus.cc:2454] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:38:57.278748 23681 raft_consensus.cc:1261] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260807 13:38:57.256596 24805 raft_consensus.cc:3037] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:57.245589 23469 rpcz_store.cc:276] 0807 13:38:55.797840 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.175502 (+1377662us) service_pool.cc:227] Handling call
0807 13:38:57.189546 (+ 14044us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.236733 23675 rpcz_store.cc:276] 0807 13:38:54.318321 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.148135 (+2829814us) service_pool.cc:227] Handling call
0807 13:38:57.148773 (+ 638us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:57.179851 (+ 31078us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.182786 (+ 2935us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.289093 23681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 441) took 2831 ms. Trace:
I20260807 13:38:57.292361 23681 rpcz_store.cc:276] 0807 13:38:54.457361 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.219848 (+2762487us) service_pool.cc:227] Handling call
0807 13:38:57.260589 (+ 40741us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:57.285150 (+ 24561us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.289023 (+ 3873us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.255968 24863 leader_election.cc:288] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:57.257833 23475 raft_consensus.cc:2454] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:57.290313 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:57.254467 23575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 331) took 2004 ms. Trace:
I20260807 13:38:57.275437 24647 raft_consensus.cc:482] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:57.280241 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9fcdd060ef64874a8719c95b2325942" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:57.275629 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 232007us
I20260807 13:38:57.292266 23633 leader_election.cc:302] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:57.284448 23672 rpcz_store.cc:276] 0807 13:38:55.579791 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.133711 (+1553920us) service_pool.cc:227] Handling call
0807 13:38:57.248418 (+114707us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:38:57.385576 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 91663.9us
I20260807 13:38:57.259104 23677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 447) took 2439 ms. Trace:
I20260807 13:38:57.272732 23574 raft_consensus.cc:2454] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
W20260807 13:38:57.469146 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 65627.6us
I20260807 13:38:57.361454 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:57.532111 23680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57116 (request call id 477) took 1020 ms. Trace:
I20260807 13:38:57.365685 23681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 457) took 2509 ms. Trace:
I20260807 13:38:57.385848 23679 raft_consensus.cc:1226] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:38:57.218076 23582 rpcz_store.cc:276] 0807 13:38:55.252179 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.008227 (+1756048us) service_pool.cc:227] Handling call
0807 13:38:57.008930 (+ 703us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:57.009605 (+ 675us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:38:57.054962 (+ 45357us) log.cc:842] Serialized 14 byte log entry
0807 13:38:57.217090 (+162128us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:57.217143 (+ 53us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:57.217194 (+ 51us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.217271 (+ 77us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:57.217423 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":74101,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":19371,"raft.queue_time_us":167,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":107,"thread_start_us":173070,"threads_started":2}
I20260807 13:38:57.355336 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220c24fa0c52459182e1e89c74331f3b" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:57.408764 23533 leader_election.cc:302] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:57.249964 23671 rpcz_store.cc:276] 0807 13:38:54.328324 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.153684 (+2825360us) service_pool.cc:227] Handling call
0807 13:38:57.154285 (+ 601us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:57.195718 (+ 41433us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.243882 (+ 48164us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.276832 23674 raft_consensus.cc:2454] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
I20260807 13:38:57.414206 24740 raft_consensus.cc:482] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:57.568766 23572 raft_consensus.cc:2379] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 4: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:57.571156 23429 leader_election.cc:302] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:57.571933 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220c24fa0c52459182e1e89c74331f3b" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:57.294275 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:57.577039 23681 rpcz_store.cc:276] 0807 13:38:54.855857 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.328891 (+2473034us) service_pool.cc:227] Handling call
0807 13:38:57.359472 (+ 30581us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:57.364759 (+ 5287us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:57.364796 (+ 37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:57.364856 (+ 60us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:57.364906 (+ 50us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.364983 (+ 77us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:57.365200 (+ 217us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.576316 23680 rpcz_store.cc:276] 0807 13:38:56.512180 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.028308 (+516128us) service_pool.cc:227] Handling call
0807 13:38:57.531788 (+503480us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b540018b5d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:57.532025 (+ 237us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":257121664}
I20260807 13:38:57.578202 23481 raft_consensus.cc:2396] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:38:57.629607 23739 tablet_bootstrap.cc:492] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:57.665181 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 337) took 1261 ms. Trace:
I20260807 13:38:57.665778 23481 rpcz_store.cc:276] 0807 13:38:56.403721 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.332070 (+928349us) service_pool.cc:227] Handling call
0807 13:38:57.665097 (+333027us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:38:57.627831 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 50992.3us
I20260807 13:38:57.407486 23471 raft_consensus.cc:2454] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 5.
W20260807 13:38:57.673813 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 383647us
I20260807 13:38:57.623442 23679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 456) took 2723 ms. Trace:
I20260807 13:38:57.691020 23679 rpcz_store.cc:276] 0807 13:38:54.855495 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.282396 (+2426901us) service_pool.cc:227] Handling call
0807 13:38:57.329437 (+ 47041us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:57.578984 (+249547us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.579269 (+ 285us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.562790 24647 raft_consensus.cc:3037] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:38:57.578151 25013 log.cc:924] Time spent T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.173s user 0.001s sys 0.000s
I20260807 13:38:57.295279 25004 raft_consensus.cc:3032] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:57.699426 23478 raft_consensus.cc:2354] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 2. Current term is 3.
I20260807 13:38:57.694252 23471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 333) took 1290 ms. Trace:
I20260807 13:38:57.560592 23575 rpcz_store.cc:276] 0807 13:38:55.250432 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.005613 (+1755181us) service_pool.cc:227] Handling call
0807 13:38:57.006613 (+ 1000us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:57.051353 (+ 44740us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:57.051403 (+ 50us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:57.052495 (+ 1092us) log.cc:842] Serialized 26 byte log entry
0807 13:38:57.205949 (+153454us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:57.219239 (+ 13290us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.244993 (+ 25754us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:57.246319 (+ 1326us) raft_consensus.cc:1671] finished
0807 13:38:57.248380 (+ 2061us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:57.253222 (+ 4842us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22954,"raft.queue_time_us":40660,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":369,"thread_start_us":114328,"threads_started":1,"wal-append.queue_time_us":175945}
I20260807 13:38:57.561692 23473 raft_consensus.cc:2454] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:57.637640 24519 raft_consensus.cc:482] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:57.575937 23469 raft_consensus.cc:1226] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4. Ops: []
I20260807 13:38:57.661355 24881 raft_consensus.cc:482] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:57.738330 24881 raft_consensus.cc:504] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:57.742102 24881 leader_election.cc:288] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
W20260807 13:38:57.706175 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 135166us
I20260807 13:38:57.619963 23574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 342) took 1845 ms. Trace:
I20260807 13:38:57.748061 23574 rpcz_store.cc:276] 0807 13:38:55.774762 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:56.988098 (+1213336us) service_pool.cc:227] Handling call
0807 13:38:57.578664 (+590566us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.712091 25012 raft_consensus.cc:2781] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:38:57.748925 23429 leader_election.cc:302] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:57.749040 25012 raft_consensus.cc:482] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:57.749687 25012 raft_consensus.cc:3037] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:38:57.749972 25020 log.cc:924] Time spent T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.077s user 0.001s sys 0.000s
I20260807 13:38:57.750155 23574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 341) took 1997 ms. Trace:
I20260807 13:38:57.708904 23571 raft_consensus.cc:2454] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:57.564769 23677 rpcz_store.cc:276] 0807 13:38:54.813487 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.235249 (+2421762us) service_pool.cc:227] Handling call
0807 13:38:57.235768 (+ 519us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:57.244746 (+ 8978us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.253284 (+ 8538us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.734655 25025 raft_consensus.cc:482] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:57.735451 23633 leader_election.cc:302] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:57.409986 24908 raft_consensus.cc:504] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:57.731916 23739 ts_tablet_manager.cc:1397] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 1.889s user 0.033s sys 0.034s
I20260807 13:38:57.742409 23737 tablet_bootstrap.cc:654] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:57.638554 24830 raft_consensus.cc:2726] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:38:57.748519 23671 raft_consensus.cc:1226] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:57.707223 25004 raft_consensus.cc:729] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:57.752712 23481 raft_consensus.cc:1226] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [term 4 LEADER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4. Ops: []
I20260807 13:38:57.772957 23681 raft_consensus.cc:3037] T 356c6b3e51454d418acaa9be70bb9689 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:38:57.697916 25001 consensus_meta.cc:287] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.566s user 0.004s sys 0.008s
I20260807 13:38:57.775172 23680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 460) took 2869 ms. Trace:
I20260807 13:38:57.775601 23680 rpcz_store.cc:276] 0807 13:38:54.905789 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.664324 (+2758535us) service_pool.cc:227] Handling call
0807 13:38:57.732749 (+ 68425us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:57.774805 (+ 42056us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:57.774833 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:57.774878 (+ 45us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:57.774911 (+ 33us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.774976 (+ 65us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:57.775104 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.730588 25026 raft_consensus.cc:482] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:57.707881 23578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 333) took 2440 ms. Trace:
I20260807 13:38:57.750658 23574 rpcz_store.cc:276] 0807 13:38:55.752678 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.748972 (+1996294us) service_pool.cc:227] Handling call
0807 13:38:57.749412 (+ 440us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:57.749723 (+ 311us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:57.749779 (+ 56us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:57.749835 (+ 56us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:57.749865 (+ 30us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.749938 (+ 73us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:57.750071 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:38:57.773845 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 74759us
I20260807 13:38:57.707437 23471 rpcz_store.cc:276] 0807 13:38:56.402222 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.062514 (+660292us) service_pool.cc:227] Handling call
0807 13:38:57.692418 (+629904us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.771534 23572 raft_consensus.cc:1261] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260807 13:38:57.732580 23473 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 488) took 1554 ms (client timeout 1629 ms). Trace:
I20260807 13:38:57.779315 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 466) took 2509 ms. Trace:
I20260807 13:38:57.789798 23481 rpcz_store.cc:276] 0807 13:38:55.263823 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.691765 (+2427942us) service_pool.cc:227] Handling call
0807 13:38:57.737079 (+ 45314us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:57.773283 (+ 36204us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.773506 (+ 223us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.794123 23679 raft_consensus.cc:3037] T 4996c3c52ccc41b9a8da11ca747a8e6a P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:38:57.795439 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 409783us
I20260807 13:38:57.784034 23633 leader_election.cc:302] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:57.796921 23572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 338) took 2055 ms. Trace:
I20260807 13:38:57.797416 23572 rpcz_store.cc:276] 0807 13:38:55.733303 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.694726 (+1961423us) service_pool.cc:227] Handling call
0807 13:38:57.744901 (+ 50175us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:57.788124 (+ 43223us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.788443 (+ 319us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.802742 23581 raft_consensus.cc:2454] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 5.
I20260807 13:38:57.809090 23533 leader_election.cc:302] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:57.778576 24881 raft_consensus.cc:2781] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:38:57.783286 24948 raft_consensus.cc:2781] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:38:57.787253 23469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 454) took 2521 ms. Trace:
I20260807 13:38:57.815563 23633 leader_election.cc:302] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:57.820845 25015 raft_consensus.cc:2781] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:57.821497 25015 raft_consensus.cc:482] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:57.821934 25015 raft_consensus.cc:3037] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:57.804842 23671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 469) took 2225 ms. Trace:
I20260807 13:38:57.831084 23633 leader_election.cc:302] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:57.836237 23577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 337) took 2106 ms. Trace:
I20260807 13:38:57.836781 23577 rpcz_store.cc:276] 0807 13:38:55.730256 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.696166 (+1965910us) service_pool.cc:227] Handling call
0807 13:38:57.785841 (+ 89675us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:57.832544 (+ 46703us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:57.835750 (+ 3206us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:57.835842 (+ 92us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:57.835886 (+ 44us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.835972 (+ 86us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:57.836147 (+ 175us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.824424 24732 raft_consensus.cc:2781] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:38:57.823453 23469 rpcz_store.cc:276] 0807 13:38:55.255685 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.333634 (+2077949us) service_pool.cc:227] Handling call
0807 13:38:57.506870 (+173236us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:57.744736 (+237866us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.773895 (+ 29159us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.817528 24948 raft_consensus.cc:482] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:57.790506 25026 raft_consensus.cc:504] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:57.856369 23479 consensus_meta.cc:287] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.714s user 0.016s sys 0.000s
I20260807 13:38:57.770836 24519 raft_consensus.cc:504] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:57.864408 25031 raft_consensus.cc:482] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:57.772732 24740 raft_consensus.cc:504] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:57.789523 23473 rpcz_store.cc:269] 0807 13:38:56.171369 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:56.900002 (+728633us) service_pool.cc:227] Handling call
0807 13:38:57.725503 (+825501us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":182016}
I20260807 13:38:57.832993 23671 rpcz_store.cc:276] 0807 13:38:55.579397 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.693803 (+2114406us) service_pool.cc:227] Handling call
0807 13:38:57.748282 (+ 54479us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:57.776510 (+ 28228us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.800797 (+ 24287us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:38:57.870034 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 45154.2us
I20260807 13:38:57.870849 23633 leader_election.cc:302] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:57.857219 24948 raft_consensus.cc:3037] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:38:57.858775 23479 raft_consensus.cc:2454] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:38:57.824679 24830 consensus_queue.cc:1035] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260807 13:38:57.860651 24434 raft_consensus.cc:2781] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260807 13:38:57.832893 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 82024.3us
W20260807 13:38:57.881932 23479 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 340) took 1477 ms (client timeout 1964 ms). Trace:
I20260807 13:38:57.884881 25030 raft_consensus.cc:2781] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260807 13:38:57.885491 25011 log.cc:924] Time spent T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.480s user 0.004s sys 0.000s
W20260807 13:38:57.895418 23479 rpcz_store.cc:269] 0807 13:38:56.404763 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.066479 (+661716us) service_pool.cc:227] Handling call
0807 13:38:57.881863 (+815384us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.866503 23478 raft_consensus.cc:3037] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 2
I20260807 13:38:57.824543 25001 consensus_queue.cc:1046] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260807 13:38:57.807520 25025 raft_consensus.cc:504] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:57.872756 23582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 339) took 2135 ms. Trace:
I20260807 13:38:57.919786 23572 raft_consensus.cc:1261] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:38:57.923054 23677 raft_consensus.cc:1226] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260807 13:38:57.927589 23480 consensus_meta.cc:287] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.646s user 0.014s sys 0.000s
I20260807 13:38:57.888897 24434 raft_consensus.cc:482] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:57.939836 23429 leader_election.cc:302] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:57.901695 23739 raft_consensus.cc:348] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:57.896588 25030 raft_consensus.cc:482] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:57.896067 24881 raft_consensus.cc:686] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:57.924587 23575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 340) took 2176 ms. Trace:
I20260807 13:38:57.943445 23739 raft_consensus.cc:374] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:57.958396 23739 raft_consensus.cc:729] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
W20260807 13:38:57.924842 24652 consensus_meta.cc:287] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.693s user 0.004s sys 0.010s
I20260807 13:38:57.942476 23480 raft_consensus.cc:2454] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4.
I20260807 13:38:57.961525 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 341) took 1556 ms. Trace:
I20260807 13:38:57.962152 23480 rpcz_store.cc:276] 0807 13:38:56.405087 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.237357 (+832270us) service_pool.cc:227] Handling call
0807 13:38:57.961439 (+724082us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.944937 24434 raft_consensus.cc:3037] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:57.927140 23582 rpcz_store.cc:276] 0807 13:38:55.736930 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.704987 (+1968057us) service_pool.cc:227] Handling call
0807 13:38:57.804785 (+ 99798us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:57.826753 (+ 21968us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:57.830731 (+ 3978us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:57.832803 (+ 2072us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:57.848502 (+ 15699us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.859192 (+ 10690us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:57.870289 (+ 11097us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:57.966836 23739 consensus_queue.cc:260] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:57.950956 23471 raft_consensus.cc:1261] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260807 13:38:57.976285 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 90045.9us
I20260807 13:38:57.950556 25026 leader_election.cc:288] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:57.953248 25030 raft_consensus.cc:3037] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:57.900375 25031 raft_consensus.cc:504] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:57.975631 25003 consensus_meta.cc:287] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.750s user 0.010s sys 0.005s
W20260807 13:38:57.982985 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 124912us
I20260807 13:38:57.971887 24732 raft_consensus.cc:686] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:57.958171 23575 rpcz_store.cc:276] 0807 13:38:55.738773 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.761192 (+2022419us) service_pool.cc:227] Handling call
0807 13:38:57.825521 (+ 64329us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:57.870238 (+ 44717us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:57.875759 (+ 5521us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:57.881565 (+ 5806us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:57.889421 (+ 7856us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.900157 (+ 10736us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:57.915354 (+ 15197us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":139468,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":155}
I20260807 13:38:58.107874 24893 consensus_queue.cc:1046] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:57.995895 25041 raft_consensus.cc:2781] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:38:57.975036 24908 leader_election.cc:288] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:58.164832 24647 raft_consensus.cc:504] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.003104 23677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 473) took 2257 ms. Trace:
W20260807 13:38:58.113317 24805 consensus_meta.cc:287] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.754s user 0.012s sys 0.000s
I20260807 13:38:58.084547 23471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 320) took 2696 ms. Trace:
I20260807 13:38:57.971073 24652 raft_consensus.cc:504] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
PC: @ 0x0 (unknown)
I20260807 13:38:58.086205 25026 raft_consensus.cc:2781] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:38:57.995769 25003 raft_consensus.cc:504] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:57.777802 23578 rpcz_store.cc:276] 0807 13:38:55.263894 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.028150 (+1764256us) service_pool.cc:227] Handling call
0807 13:38:57.028746 (+ 596us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:57.029279 (+ 533us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:38:57.256495 (+227216us) log.cc:842] Serialized 14 byte log entry
0807 13:38:57.622351 (+365856us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:57.642754 (+ 20403us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:57.664010 (+ 21256us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.680822 (+ 16812us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:57.697770 (+ 16948us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":152439,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":178590,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":152,"spinlock_wait_cycles":40320,"thread_start_us":305399,"threads_started":2,"wal-append.queue_time_us":282484}
I20260807 13:38:57.997879 23739 ts_tablet_manager.cc:1428] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.230s user 0.005s sys 0.005s
I20260807 13:38:58.118247 23680 raft_consensus.cc:1226] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260807 13:38:58.004803 25025 leader_election.cc:288] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:57.997819 24881 consensus_queue.cc:237] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.100850 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 328) took 2799 ms. Trace:
I20260807 13:38:58.232002 23480 rpcz_store.cc:276] 0807 13:38:55.301062 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.977435 (+2676373us) service_pool.cc:227] Handling call
0807 13:38:58.064453 (+ 87018us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:58.098126 (+ 33673us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:58.098230 (+ 104us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:58.098493 (+ 263us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:58.098844 (+ 351us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.099294 (+ 450us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:58.100348 (+ 1054us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:58.008337 25033 raft_consensus.cc:2781] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260807 13:38:58.108946 25029 log.cc:924] Time spent T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.157s user 0.000s sys 0.000s
W20260807 13:38:58.118147 23674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57116 (request call id 471) took 2443 ms (client timeout 2004 ms). Trace:
I20260807 13:38:57.888914 25004 consensus_queue.cc:260] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:58.120262 24345 consensus_meta.cc:287] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.963s user 0.018s sys 0.013s
W20260807 13:38:58.090387 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 86131.4us
W20260807 13:38:58.092710 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 283687us
I20260807 13:38:58.208029 24740 leader_election.cc:288] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:58.211959 24732 consensus_queue.cc:237] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.214455 24893 raft_consensus.cc:3032] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:38:58.221659 24647 leader_election.cc:288] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:58.247273 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 329) took 2921 ms. Trace:
I20260807 13:38:58.247678 23480 rpcz_store.cc:276] 0807 13:38:55.325819 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:58.242019 (+2916200us) service_pool.cc:227] Handling call
0807 13:38:58.246726 (+ 4707us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:58.246955 (+ 229us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:58.246981 (+ 26us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:58.247019 (+ 38us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:58.247045 (+ 26us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.247093 (+ 48us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:58.247192 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:58.248184 23737 tablet_bootstrap.cc:492] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:58.248879 23737 ts_tablet_manager.cc:1397] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 1.023s user 0.033s sys 0.031s
I20260807 13:38:58.221876 23671 raft_consensus.cc:1226] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 2. Current term is 3. Ops: []
I20260807 13:38:58.249727 23675 raft_consensus.cc:1226] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 5. Current term is 6. Ops: []
I20260807 13:38:58.250633 23470 raft_consensus.cc:1226] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 5. Current term is 6. Ops: []
W20260807 13:38:58.224493 23430 connection.cc:232] RPC call timeout handler was delayed by -4.1714674120303243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
I20260807 13:38:58.227311 25041 raft_consensus.cc:686] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:58.227982 25031 leader_election.cc:288] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:58.228202 23574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 351) took 2271 ms. Trace:
W20260807 13:38:58.251469 23430 connection.cc:232] RPC call timeout handler was delayed by -4.1489674120675772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
I20260807 13:38:58.234242 25033 raft_consensus.cc:482] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
W20260807 13:38:58.228694 23573 consensus_meta.cc:287] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 1.011s user 0.014s sys 0.001s
W20260807 13:38:58.251938 23430 connection.cc:232] RPC call timeout handler was delayed by -4.136367412051186s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
I20260807 13:38:58.252331 23573 raft_consensus.cc:2454] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4.
I20260807 13:38:58.252111 24948 raft_consensus.cc:504] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:58.252674 23430 leader_election.cc:334] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: RPC error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Timed out: RequestConsensusVote RPC to 127.21.69.2:33363 timed out after 1.666s (SENT)
I20260807 13:38:58.252943 23573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 359) took 1135 ms. Trace:
I20260807 13:38:58.253352 23573 rpcz_store.cc:276] 0807 13:38:57.118058 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.140928 (+ 22870us) service_pool.cc:227] Handling call
0807 13:38:58.252868 (+1111940us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:58.204481 23672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 459) took 3260 ms. Trace:
I20260807 13:38:58.254621 24948 leader_election.cc:288] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 6 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:58.254989 23577 raft_consensus.cc:1226] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4. Ops: []
I20260807 13:38:58.255329 25004 raft_consensus.cc:3037] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:38:58.232704 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 252678us
W20260807 13:38:58.231383 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 58390.4us
W20260807 13:38:58.237056 23674 rpcz_store.cc:269] 0807 13:38:55.674343 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:56.046574 (+372231us) service_pool.cc:227] Handling call
0807 13:38:58.117792 (+2071218us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54003697d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:58.118042 (+ 250us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":326472576}
I20260807 13:38:58.251055 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 336) took 2522 ms. Trace:
I20260807 13:38:58.256841 23633 leader_election.cc:302] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:58.256790 23580 rpcz_store.cc:276] 0807 13:38:55.728883 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.293969 (+1565086us) service_pool.cc:227] Handling call
0807 13:38:57.380068 (+ 86099us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:57.456801 (+ 76733us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:57.456867 (+ 66us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:57.563711 (+106844us) log.cc:842] Serialized 26 byte log entry
0807 13:38:57.798063 (+234352us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:38:57.798119 (+ 56us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.798233 (+ 114us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:58.250823 (+452590us) raft_consensus.cc:1671] finished
0807 13:38:58.250849 (+ 26us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:58.250997 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":97986,"threads_started":1,"wal-append.queue_time_us":165495}
I20260807 13:38:58.264760 25041 consensus_queue.cc:237] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.265699 24647 raft_consensus.cc:2781] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:58.266285 24647 raft_consensus.cc:686] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:58.265455 24652 leader_election.cc:288] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:58.267279 24647 consensus_queue.cc:237] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.243369 24345 raft_consensus.cc:504] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.272027 23475 raft_consensus.cc:1226] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:58.269860 23676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 451) took 3447 ms. Trace:
I20260807 13:38:58.230137 24805 raft_consensus.cc:504] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.276710 23572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 355) took 1492 ms. Trace:
I20260807 13:38:58.252043 25033 raft_consensus.cc:3037] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:58.279953 23572 rpcz_store.cc:276] 0807 13:38:56.784565 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.813313 (+1028748us) service_pool.cc:227] Handling call
0807 13:38:57.856314 (+ 43001us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:57.920507 (+ 64193us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.276320 (+355813us) spinlock_profiling.cc:243] Waited 49.1 ms on lock 0x7b5400385754. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:58.276625 (+ 305us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":112839936}
I20260807 13:38:58.245958 25026 raft_consensus.cc:686] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 5 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:58.245384 24893 raft_consensus.cc:729] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:58.284950 23479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 327) took 2984 ms. Trace:
I20260807 13:38:58.210623 23471 rpcz_store.cc:276] 0807 13:38:55.289513 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.812553 (+2523040us) service_pool.cc:227] Handling call
0807 13:38:57.869092 (+ 56539us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:57.975409 (+106317us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.985889 (+ 10480us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:58.267776 24434 raft_consensus.cc:504] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.254402 23672 rpcz_store.cc:276] 0807 13:38:54.898488 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.572946 (+2674458us) service_pool.cc:227] Handling call
0807 13:38:57.573502 (+ 556us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:57.698718 (+125216us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:38:57.770524 (+ 71806us) log.cc:842] Serialized 14 byte log entry
0807 13:38:57.956035 (+185511us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:58.007150 (+ 51115us) log.cc:842] Serialized 26 byte log entry
0807 13:38:58.007387 (+ 237us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:38:58.007770 (+ 383us) log.cc:842] Serialized 14 byte log entry
0807 13:38:58.008001 (+ 231us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.008108 (+ 107us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:58.119889 (+111781us) raft_consensus.cc:1671] finished
0807 13:38:58.133451 (+ 13562us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:58.158324 (+ 24873us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":115522,"prepare.queue_time_us":57337,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":84,"raft.queue_time_us":168594,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":9456,"thread_start_us":138150,"threads_started":1,"wal-append.queue_time_us":189917}
I20260807 13:38:58.296877 24434 leader_election.cc:288] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:58.235110 25012 raft_consensus.cc:504] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.206597 23677 rpcz_store.cc:276] 0807 13:38:55.745714 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.773931 (+2028217us) service_pool.cc:227] Handling call
0807 13:38:57.833328 (+ 59397us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:57.923733 (+ 90405us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.002654 (+ 78921us) spinlock_profiling.cc:243] Waited 63.4 ms on lock 0x7b540035a2d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:58.002988 (+ 334us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":145722752}
W20260807 13:38:58.301303 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 47506.6us
I20260807 13:38:58.291136 23479 rpcz_store.cc:276] 0807 13:38:55.300709 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.896824 (+2596115us) service_pool.cc:227] Handling call
0807 13:38:57.915464 (+ 18640us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:57.960470 (+ 45006us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:38:57.980792 (+ 20322us) log.cc:842] Serialized 14 byte log entry
0807 13:38:58.284595 (+303803us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:58.284658 (+ 63us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:58.284698 (+ 40us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.284772 (+ 74us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:58.284891 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":32268,"prepare.queue_time_us":21695,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":102118,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":1537,"thread_start_us":144194,"threads_started":2,"wal-append.queue_time_us":212653}
I20260807 13:38:58.302950 23737 raft_consensus.cc:348] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.303808 23737 raft_consensus.cc:374] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:58.304086 23737 raft_consensus.cc:729] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
W20260807 13:38:58.303956 23430 connection.cc:232] RPC call timeout handler was delayed by -3.9295621041674167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3733s for a response
I20260807 13:38:58.305385 23739 tablet_bootstrap.cc:492] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
W20260807 13:38:58.304873 23430 connection.cc:232] RPC call timeout handler was delayed by -3.9275674119126052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
I20260807 13:38:58.240772 25015 raft_consensus.cc:504] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.306757 23737 consensus_queue.cc:260] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:58.333707 23430 connection.cc:232] RPC call timeout handler was delayed by -3.8620760589838028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
W20260807 13:38:58.335223 23532 leader_election.cc:334] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 1.752s (SENT)
I20260807 13:38:58.312520 23472 raft_consensus.cc:1226] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4. Ops: []
I20260807 13:38:58.335897 23532 leader_election.cc:302] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
W20260807 13:38:58.337497 23532 leader_election.cc:334] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 1.783s (SENT)
I20260807 13:38:58.337976 23532 leader_election.cc:302] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:58.338917 24948 raft_consensus.cc:2726] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:38:58.345666 23430 connection.cc:232] RPC call timeout handler was delayed by -3.715496112126857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17980000000000002s for a response
W20260807 13:38:58.346271 23430 connection.cc:232] RPC call timeout handler was delayed by -3.6247301730327308s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260807 13:38:58.346684 23430 connection.cc:232] RPC call timeout handler was delayed by -3.61886741197668s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
W20260807 13:38:58.347059 23430 connection.cc:232] RPC call timeout handler was delayed by -3.6107674119994044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2138s for a response
W20260807 13:38:58.347429 23430 connection.cc:232] RPC call timeout handler was delayed by -3.610767109086737s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2902s for a response
W20260807 13:38:58.347872 23430 connection.cc:232] RPC call timeout handler was delayed by -3.6091722359415144s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3294s for a response
W20260807 13:38:58.348240 23430 connection.cc:232] RPC call timeout handler was delayed by -3.5484956400468946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
W20260807 13:38:58.348618 23430 connection.cc:232] RPC call timeout handler was delayed by -3.507554590003565s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4911s for a response
W20260807 13:38:58.349004 23430 connection.cc:232] RPC call timeout handler was delayed by -3.4590612750034779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2046s for a response
W20260807 13:38:58.349364 23430 connection.cc:232] RPC call timeout handler was delayed by -3.2699942011386156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3227s for a response
W20260807 13:38:58.349737 23430 connection.cc:232] RPC call timeout handler was delayed by -2.9733349001035094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
W20260807 13:38:58.350095 23430 connection.cc:232] RPC call timeout handler was delayed by -2.8933444002177566s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
W20260807 13:38:58.350508 23430 connection.cc:232] RPC call timeout handler was delayed by -2.7848778849001974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
I20260807 13:38:58.354926 23737 ts_tablet_manager.cc:1428] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.106s user 0.010s sys 0.002s
I20260807 13:38:58.355163 23679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 472) took 2614 ms. Trace:
I20260807 13:38:58.356278 23737 tablet_bootstrap.cc:492] T 39707c5d97164544b9f5c03db41181c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:58.355582 23679 rpcz_store.cc:276] 0807 13:38:55.740473 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.751759 (+2011286us) service_pool.cc:227] Handling call
0807 13:38:57.793882 (+ 42123us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:57.968609 (+174727us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:57.968644 (+ 35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:57.969299 (+ 655us) log.cc:842] Serialized 26 byte log entry
0807 13:38:58.221112 (+251813us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:38:58.221159 (+ 47us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.221246 (+ 87us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:58.354880 (+133634us) raft_consensus.cc:1671] finished
0807 13:38:58.354920 (+ 40us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:58.355094 (+ 174us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":113546,"raft.queue_time_us":117502,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"thread_start_us":160639,"threads_started":1,"wal-append.queue_time_us":314204}
I20260807 13:38:58.358584 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:58.359596 23633 leader_election.cc:302] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:58.308641 25003 leader_election.cc:288] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:58.365116 23681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 465) took 3165 ms. Trace:
I20260807 13:38:58.365742 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:38:58.366411 23430 connection.cc:232] RPC call timeout handler was delayed by -2.482477884972468s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1956s for a response
I20260807 13:38:58.367432 23479 raft_consensus.cc:3037] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:38:58.368462 23532 leader_election.cc:334] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 1.937s (SENT)
I20260807 13:38:58.365712 23681 rpcz_store.cc:276] 0807 13:38:55.199990 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.667987 (+2467997us) service_pool.cc:227] Handling call
0807 13:38:57.724695 (+ 56708us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:58.209527 (+484832us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:58.209575 (+ 48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:58.210162 (+ 587us) log.cc:842] Serialized 26 byte log entry
0807 13:38:58.283275 (+ 73113us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:58.303295 (+ 20020us) log.cc:842] Serialized 14 byte log entry
0807 13:38:58.335805 (+ 32510us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.335892 (+ 87us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:58.364828 (+ 28936us) raft_consensus.cc:1671] finished
0807 13:38:58.364857 (+ 29us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:58.365033 (+ 176us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":19711,"prepare.queue_time_us":20264,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":42844,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":218,"thread_start_us":54065,"threads_started":1,"wal-append.queue_time_us":65041}
I20260807 13:38:58.373425 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 478) took 2632 ms. Trace:
I20260807 13:38:58.373853 24345 leader_election.cc:288] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:58.351948 25031 raft_consensus.cc:2726] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:38:58.373940 23480 rpcz_store.cc:276] 0807 13:38:55.741014 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:58.248533 (+2507519us) service_pool.cc:227] Handling call
0807 13:38:58.248920 (+ 387us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:58.249175 (+ 255us) raft_consensus.cc:1520] Early marking committed up to index 1
0807 13:38:58.256091 (+ 6916us) log.cc:842] Serialized 14 byte log entry
0807 13:38:58.372979 (+116888us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:58.373041 (+ 62us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:58.373100 (+ 59us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.373231 (+ 131us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:58.373362 (+ 131us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":1242,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":3267,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"thread_start_us":112938,"threads_started":1}
W20260807 13:38:58.375828 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 66686.5us
I20260807 13:38:58.376609 24805 leader_election.cc:288] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:58.376710 23633 leader_election.cc:302] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:58.377534 23679 raft_consensus.cc:1226] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 2. Current term is 3. Ops: []
I20260807 13:38:58.378278 24647 raft_consensus.cc:2781] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:38:58.379029 24647 raft_consensus.cc:686] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:58.379199 25054 raft_consensus.cc:2781] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:58.379741 25054 raft_consensus.cc:482] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:38:58.380187 24434 consensus_queue.cc:1035] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:58.380154 24647 consensus_queue.cc:237] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.381446 23679 raft_consensus.cc:1226] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4. Ops: []
I20260807 13:38:58.380136 25054 raft_consensus.cc:3037] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:58.362875 23674 raft_consensus.cc:1226] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 LEADER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 2. Current term is 3. Ops: []
I20260807 13:38:58.385238 23473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 326) took 3084 ms. Trace:
I20260807 13:38:58.385684 23473 rpcz_store.cc:276] 0807 13:38:55.300367 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.877055 (+2576688us) service_pool.cc:227] Handling call
0807 13:38:57.877611 (+ 556us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:57.878178 (+ 567us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:57.878215 (+ 37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:57.928851 (+ 50636us) log.cc:842] Serialized 26 byte log entry
0807 13:38:58.236580 (+307729us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:38:58.242848 (+ 6268us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.245582 (+ 2734us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:58.384996 (+139414us) raft_consensus.cc:1671] finished
0807 13:38:58.385015 (+ 19us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:58.385164 (+ 149us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1555,"raft.queue_time_us":8748,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":5104,"thread_start_us":232597,"threads_started":1,"wal-append.queue_time_us":337535}
I20260807 13:38:58.385254 23469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 325) took 3085 ms. Trace:
I20260807 13:38:58.387701 23677 raft_consensus.cc:1261] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:38:58.388391 23677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 485) took 1263 ms. Trace:
I20260807 13:38:58.388895 23671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 448) took 1688 ms. Trace:
I20260807 13:38:58.389500 23671 rpcz_store.cc:276] 0807 13:38:56.700931 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.884966 (+1184035us) service_pool.cc:227] Handling call
0807 13:38:57.885427 (+ 461us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:58.249557 (+364130us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.388592 (+139035us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b54002cb0d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:58.388820 (+ 228us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":770167680}
I20260807 13:38:58.387521 25012 leader_election.cc:288] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
*** SIGABRT (@0x3e800005514) received by PID 21780 (TID 0x7fc690d69880) from PID 21780; stack trace: ***
I20260807 13:38:58.387954 23469 rpcz_store.cc:276] 0807 13:38:55.299986 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.840629 (+2540643us) service_pool.cc:227] Handling call
0807 13:38:57.878755 (+ 38126us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:57.879403 (+ 648us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:57.879452 (+ 49us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:57.958303 (+ 78851us) log.cc:842] Serialized 26 byte log entry
0807 13:38:58.238969 (+280666us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:58.239024 (+ 55us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.239095 (+ 71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:58.384940 (+145845us) raft_consensus.cc:1671] finished
0807 13:38:58.384977 (+ 37us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:58.385158 (+ 181us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":43584,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":141,"thread_start_us":148858,"threads_started":1,"wal-append.queue_time_us":312417}
@ 0x29bbc0 __tsan::CallUserSignalHandler() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1915
@ 0x29e2b0 rtl_sigaction() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:2005
I20260807 13:38:58.351660 24903 raft_consensus.cc:482] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:58.379227 23633 leader_election.cc:302] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:58.318192 25001 consensus_queue.cc:1035] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
W20260807 13:38:58.429473 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 66943.3us
I20260807 13:38:58.430043 25058 consensus_queue.cc:1046] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.059s
I20260807 13:38:58.430874 23533 leader_election.cc:302] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
W20260807 13:38:58.431529 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 52445us
I20260807 13:38:58.388742 23677 rpcz_store.cc:276] 0807 13:38:57.129687 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:58.311914 (+1182227us) service_pool.cc:227] Handling call
0807 13:38:58.345425 (+ 33511us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:58.388081 (+ 42656us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.388324 (+ 243us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:58.438657 23471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 331) took 2045 ms. Trace:
I20260807 13:38:58.439390 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
W20260807 13:38:58.450541 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 50581.1us
W20260807 13:38:58.454559 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 59934.8us
I20260807 13:38:58.456295 23737 tablet_bootstrap.cc:654] T 39707c5d97164544b9f5c03db41181c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:58.272728 23676 rpcz_store.cc:276] 0807 13:38:54.821432 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.253366 (+2431934us) service_pool.cc:227] Handling call
0807 13:38:57.368003 (+114637us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:57.436648 (+ 68645us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:57.436705 (+ 57us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:57.437378 (+ 673us) log.cc:842] Serialized 26 byte log entry
0807 13:38:57.735180 (+297802us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:57.854189 (+119009us) log.cc:842] Serialized 14 byte log entry
0807 13:38:58.233071 (+378882us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.238684 (+ 5613us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:58.239363 (+ 679us) raft_consensus.cc:1671] finished
0807 13:38:58.241607 (+ 2244us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:58.268490 (+ 26883us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":79931,"prepare.queue_time_us":34585,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":109021,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":136,"thread_start_us":605183,"threads_started":3,"wal-append.queue_time_us":289986}
I20260807 13:38:58.251794 23574 rpcz_store.cc:276] 0807 13:38:55.956662 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.800682 (+1844020us) service_pool.cc:227] Handling call
0807 13:38:57.821827 (+ 21145us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:57.822221 (+ 394us) raft_consensus.cc:1520] Early marking committed up to index 3
0807 13:38:57.913933 (+ 91712us) log.cc:842] Serialized 14 byte log entry
0807 13:38:58.180293 (+266360us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:58.201750 (+ 21457us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:38:58.211523 (+ 9773us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.211618 (+ 95us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:58.228096 (+ 16478us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":76479,"prepare.queue_time_us":157006,"prepare.run_cpu_time_us":13342,"prepare.run_wall_time_us":86518,"raft.queue_time_us":112749,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":7413,"thread_start_us":106580,"threads_started":2,"wal-append.queue_time_us":271299}
I20260807 13:38:58.462292 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:58.457494 25058 raft_consensus.cc:3032] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:38:58.476035 25058 raft_consensus.cc:729] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:58.476512 25015 leader_election.cc:288] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:58.476828 23684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 439) took 4107 ms. Trace:
I20260807 13:38:58.464100 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:58.477089 25058 consensus_queue.cc:260] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.477749 23469 raft_consensus.cc:3037] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:58.451335 24903 raft_consensus.cc:504] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:38:58.453675 25026 consensus_queue.cc:237] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.478552 25058 raft_consensus.cc:3037] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:58.477330 23684 rpcz_store.cc:276] 0807 13:38:54.370344 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.179077 (+2808733us) service_pool.cc:227] Handling call
0807 13:38:57.244562 (+ 65485us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:57.252952 (+ 8390us) raft_consensus.cc:1520] Early marking committed up to index 1
0807 13:38:57.296449 (+ 43497us) log.cc:842] Serialized 14 byte log entry
0807 13:38:57.808798 (+512349us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:57.808847 (+ 49us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:57.808925 (+ 78us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:57.809013 (+ 88us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:58.293435 (+484422us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b1800329b60. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc69dfd68b1 00007fc69dfe3661 00007fc695137638 00007fc69513ab11 00007fc69513aac9 00007fc69513aa59 00007fc69513aa21 00007fc695139d1d 00007fc69e39b204 00007fc69e39b039 00007fc695119dc6
0807 13:38:58.476673 (+183238us) spinlock_profiling.cc:243] Waited 57.6 ms on lock 0x7b54000406d0. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ea09 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:58.476769 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":38719,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":10925,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":15569,"spinlock_wait_cycles":158428800,"thread_start_us":344073,"threads_started":2,"wal-append.queue_time_us":359193}
I20260807 13:38:58.479723 23680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 446) took 2037 ms. Trace:
I20260807 13:38:58.479882 24903 leader_election.cc:288] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:58.480096 23680 rpcz_store.cc:276] 0807 13:38:56.442781 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.817444 (+1374663us) service_pool.cc:227] Handling call
0807 13:38:58.118000 (+300556us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:58.231757 (+113757us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.479522 (+247765us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b54003697d0. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ea09 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:58.479666 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":682639744}
I20260807 13:38:58.471311 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 319) took 3186 ms. Trace:
I20260807 13:38:58.482506 23481 rpcz_store.cc:276] 0807 13:38:55.285061 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.790610 (+2505549us) service_pool.cc:227] Handling call
0807 13:38:58.470237 (+679627us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b5800003398. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:38:58.470558 (+ 321us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:58.470870 (+ 312us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:58.470901 (+ 31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:58.470957 (+ 56us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:58.470997 (+ 40us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.471071 (+ 74us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:58.471226 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4375296}
I20260807 13:38:58.476846 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a3da79d3b0447cbc19c4f28279e134" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:58.459123 23633 leader_election.cc:302] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:58.484791 23480 raft_consensus.cc:2362] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1. Re-sending same reply.
I20260807 13:38:58.486544 23739 tablet_bootstrap.cc:654] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
W20260807 13:38:58.486544 23532 leader_election.cc:334] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 2.078s (SENT)
I20260807 13:38:58.488313 23532 leader_election.cc:302] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:58.394086 24893 consensus_queue.cc:260] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.489961 24893 raft_consensus.cc:3037] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:58.489801 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:58.494026 23681 raft_consensus.cc:1226] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260807 13:38:58.496330 23480 raft_consensus.cc:2362] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4. Re-sending same reply.
I20260807 13:38:58.497290 24830 raft_consensus.cc:2781] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:38:58.497512 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:58.497763 24519 leader_election.cc:288] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:58.498126 24830 raft_consensus.cc:686] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:58.498987 23470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 461) took 3237 ms. Trace:
I20260807 13:38:58.475724 23478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 318) took 3191 ms. Trace:
I20260807 13:38:58.500120 25028 raft_consensus.cc:2726] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:58.499501 23470 rpcz_store.cc:276] 0807 13:38:55.261903 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.674688 (+2412785us) service_pool.cc:227] Handling call
0807 13:38:57.771399 (+ 96711us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:58.251075 (+479676us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.498741 (+247666us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b540009ddd4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:58.498920 (+ 179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1075291008}
I20260807 13:38:58.501978 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:58.499972 23478 rpcz_store.cc:276] 0807 13:38:55.284786 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.775022 (+2490236us) service_pool.cc:227] Handling call
0807 13:38:57.833066 (+ 58044us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:58.290348 (+457282us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:58.291425 (+ 1077us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:58.293916 (+ 2491us) log.cc:842] Serialized 26 byte log entry
0807 13:38:58.362171 (+ 68255us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:58.447257 (+ 85086us) log.cc:842] Serialized 14 byte log entry
0807 13:38:58.471593 (+ 24336us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.471724 (+ 131us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:58.475425 (+ 3701us) raft_consensus.cc:1671] finished
0807 13:38:58.475440 (+ 15us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:58.475619 (+ 179us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":52608,"prepare.queue_time_us":72043,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":67185,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":277,"thread_start_us":48494,"threads_started":1,"wal-append.queue_time_us":90324}
W20260807 13:38:58.492069 23533 leader_election.cc:341] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:58.475994 23675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 458) took 3619 ms. Trace:
W20260807 13:38:58.503767 23533 leader_election.cc:341] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:58.504369 23472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 467) took 3240 ms. Trace:
I20260807 13:38:58.504801 23472 rpcz_store.cc:276] 0807 13:38:55.264179 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.751038 (+2486859us) service_pool.cc:227] Handling call
0807 13:38:57.820397 (+ 69359us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:58.336421 (+516024us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.504085 (+167664us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b5400273154. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:58.504299 (+ 214us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1123467520}
I20260807 13:38:58.505813 25031 consensus_queue.cc:1035] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:58.467979 25055 raft_consensus.cc:2781] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:38:58.506821 25055 raft_consensus.cc:482] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:58.507004 23577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 422) took 1479 ms. Trace:
I20260807 13:38:58.450273 23471 rpcz_store.cc:276] 0807 13:38:56.393696 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:58.311535 (+1917839us) service_pool.cc:227] Handling call
0807 13:38:58.413888 (+102353us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:58.438198 (+ 24310us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:58.438239 (+ 41us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:58.438304 (+ 65us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:38:58.438339 (+ 35us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.438422 (+ 83us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:58.438587 (+ 165us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:38:58.457631 23671 raft_consensus.cc:1226] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260807 13:38:58.507596 23577 rpcz_store.cc:276] 0807 13:38:57.028052 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.838343 (+810291us) service_pool.cc:227] Handling call
0807 13:38:58.254755 (+416412us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:58.255508 (+ 753us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.506689 (+251181us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54004349d0. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ea09 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:38:58.506918 (+ 229us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":956583168}
I20260807 13:38:58.464514 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:58.509351 24948 consensus_queue.cc:1046] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:38:58.510167 23473 raft_consensus.cc:2454] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 5.
I20260807 13:38:58.510421 24740 raft_consensus.cc:3032] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:38:58.510793 24740 raft_consensus.cc:729] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:58.511803 24740 consensus_queue.cc:260] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.513309 24740 raft_consensus.cc:3037] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:58.514328 25054 raft_consensus.cc:504] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.507232 25055 raft_consensus.cc:3037] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:38:58.517897 23533 leader_election.cc:302] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:58.498907 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:58.518499 23478 raft_consensus.cc:1261] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:38:58.514587 23475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 460) took 3253 ms. Trace:
I20260807 13:38:58.467694 24805 raft_consensus.cc:2781] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:58.526120 23631 leader_election.cc:302] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters: 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:58.521739 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6ae70649fa43bba8052b66977418f5" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:58.522377 23479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 334) took 2119 ms. Trace:
I20260807 13:38:58.503974 23675 rpcz_store.cc:276] 0807 13:38:54.856121 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.294717 (+2438596us) service_pool.cc:227] Handling call
0807 13:38:57.295161 (+ 444us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:58.250198 (+955037us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.475708 (+225510us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b54003453d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:58.475910 (+ 202us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2176096640}
I20260807 13:38:58.527324 23479 rpcz_store.cc:276] 0807 13:38:56.402665 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:58.312727 (+1910062us) service_pool.cc:227] Handling call
0807 13:38:58.367300 (+ 54573us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:58.520635 (+153335us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:58.520663 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:38:58.521060 (+ 397us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:58.521108 (+ 48us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.522199 (+ 1091us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:58.522316 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":24080,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":2975}
I20260807 13:38:58.532634 24805 raft_consensus.cc:482] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:58.533124 24805 raft_consensus.cc:3037] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:58.536564 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:58.499413 24830 consensus_queue.cc:237] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:58.541394 23407 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:38:58.559299 23631 leader_election.cc:302] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:58.566956 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:58.567894 23478 raft_consensus.cc:3037] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Advancing to term 5
W20260807 13:38:58.565485 23532 leader_election.cc:334] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 2.134s (SENT)
W20260807 13:38:58.572043 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 144845us
I20260807 13:38:58.545547 25026 raft_consensus.cc:2781] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:38:58.547443 25046 consensus_queue.cc:1046] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260807 13:38:58.521462 25030 raft_consensus.cc:504] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.578258 25026 raft_consensus.cc:686] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 4 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:58.568668 24873 raft_consensus.cc:2781] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:58.565007 25054 leader_election.cc:288] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:58.570429 24647 raft_consensus.cc:2726] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:38:58.521687 23475 rpcz_store.cc:276] 0807 13:38:55.261553 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.638197 (+2376644us) service_pool.cc:227] Handling call
0807 13:38:57.725724 (+ 87527us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:58.272577 (+546853us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.514186 (+241609us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b54000005d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:58.514493 (+ 307us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1255903488}
I20260807 13:38:58.604238 23631 leader_election.cc:302] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:58.608284 23478 raft_consensus.cc:2454] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 5.
I20260807 13:38:58.584970 24873 raft_consensus.cc:482] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:58.627683 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:58.628440 23577 raft_consensus.cc:2362] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3. Re-sending same reply.
I20260807 13:38:58.600446 25026 consensus_queue.cc:237] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.632509 23580 raft_consensus.cc:1261] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 13:38:58.632390 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "608f7e63bc4648e0890e5f601c52736c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
W20260807 13:38:58.635582 23532 leader_election.cc:334] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 2.165s (SENT)
I20260807 13:38:58.636981 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:58.637576 25030 leader_election.cc:288] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:58.639990 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:58.640081 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:58.640892 23582 raft_consensus.cc:3037] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:58.641029 23572 raft_consensus.cc:2379] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 3: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:58.641731 23430 leader_election.cc:302] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:58.642793 24931 raft_consensus.cc:2726] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:38:58.637672 23580 raft_consensus.cc:3037] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:38:58.645797 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 64917.9us
I20260807 13:38:58.624010 24873 raft_consensus.cc:3037] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:58.655220 23581 raft_consensus.cc:1261] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260807 13:38:58.597203 24652 consensus_queue.cc:1035] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260807 13:38:58.657222 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:58.655710 23581 pending_rounds.cc:76] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1: Aborting all ops after (but not including) 1
I20260807 13:38:58.631202 24805 raft_consensus.cc:504] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.663787 23631 leader_election.cc:302] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:58.664106 24519 consensus_queue.cc:1035] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:58.660327 23581 pending_rounds.cc:97] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260807 13:38:58.667589 23581 raft_consensus.cc:2866] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:38:58.666991 23633 leader_election.cc:302] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:58.654546 25001 raft_consensus.cc:2726] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:38:58.673909 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220c24fa0c52459182e1e89c74331f3b" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:58.674494 24931 raft_consensus.cc:2781] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:58.674618 23578 raft_consensus.cc:3037] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:58.675148 24931 raft_consensus.cc:686] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:58.675832 23571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 349) took 2821 ms. Trace:
I20260807 13:38:58.680603 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:58.676183 23571 rpcz_store.cc:276] 0807 13:38:55.854665 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:57.763305 (+1908640us) service_pool.cc:227] Handling call
0807 13:38:58.515438 (+752133us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:38:58.515733 (+ 295us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:38:58.516265 (+ 532us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:58.516308 (+ 43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:38:58.516963 (+ 655us) log.cc:842] Serialized 26 byte log entry
0807 13:38:58.586210 (+ 69247us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:58.586269 (+ 59us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.586398 (+ 129us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:58.665744 (+ 79346us) raft_consensus.cc:1671] finished
0807 13:38:58.665763 (+ 19us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:58.675758 (+ 9995us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":984,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":132,"spinlock_wait_cycles":3426560,"thread_start_us":68767,"threads_started":1,"wal-append.queue_time_us":146568}
I20260807 13:38:58.680240 25041 consensus_queue.cc:1035] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
I20260807 13:38:58.671706 25033 raft_consensus.cc:504] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.684623 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:58.671599 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:58.674686 24519 consensus_queue.cc:1046] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:38:58.688553 25033 leader_election.cc:288] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:58.689189 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:58.691434 25055 raft_consensus.cc:504] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:58.692325 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 67702.6us
I20260807 13:38:58.697544 23582 raft_consensus.cc:2454] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
W20260807 13:38:58.692854 23516 tablet.cc:2369] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 13:38:58.693439 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:58.672930 25030 raft_consensus.cc:2726] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:38:58.701699 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6ae70649fa43bba8052b66977418f5" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:58.703428 23581 raft_consensus.cc:3037] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:58.706110 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:58.710297 23633 leader_election.cc:302] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:58.704201 23580 raft_consensus.cc:2454] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:38:58.720007 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:58.720937 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:58.723809 23633 leader_election.cc:302] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:58.724201 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b1542e790794928a76e4b29a1d7732b" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:58.926023 23681 raft_consensus.cc:3037] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:38:58.727618 24732 raft_consensus.cc:2781] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election won for term 3
W20260807 13:38:58.729737 23532 leader_election.cc:334] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 2.191s (SENT)
I20260807 13:38:58.927191 23532 leader_election.cc:302] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:58.927773 23674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 449) took 2225 ms. Trace:
W20260807 13:38:58.928336 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 224780us
I20260807 13:38:58.928293 23674 rpcz_store.cc:276] 0807 13:38:56.702215 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:58.291620 (+1589405us) service_pool.cc:227] Handling call
0807 13:38:58.295164 (+ 3544us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:38:58.384004 (+ 88840us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.923097 (+539093us) spinlock_profiling.cc:243] Waited 47.7 ms on lock 0x7b54002c97d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:38:58.927704 (+ 4607us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":109779712}
I20260807 13:38:58.930383 25026 raft_consensus.cc:2726] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:58.732153 23739 tablet_bootstrap.cc:492] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
W20260807 13:38:58.929915 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 206243us
I20260807 13:38:58.931442 23739 ts_tablet_manager.cc:1397] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.641s user 0.012s sys 0.030s
I20260807 13:38:58.686555 24647 consensus_queue.cc:1035] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260807 13:38:58.733368 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:58.761770 24903 consensus_queue.cc:1035] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:38:58.821806 24805 leader_election.cc:288] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:58.676134 24931 consensus_queue.cc:237] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.825294 25055 leader_election.cc:288] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:58.827976 24863 raft_consensus.cc:3032] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:38:58.828636 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:58.935590 24948 raft_consensus.cc:482] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:58.830394 23581 raft_consensus.cc:2454] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:58.755865 23573 raft_consensus.cc:2396] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:38:58.743012 23671 raft_consensus.cc:2354] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 5. Current term is 6.
I20260807 13:38:58.937376 25093 raft_consensus.cc:2781] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:58.844471 23578 raft_consensus.cc:2454] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
W20260807 13:38:58.904523 23415 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Tablet fcdef01e85a44e1093dd335055986423 (table test-workload [id=6c3159b450c749628fd57db2251c593c]) was not created within the allowed timeout. Replacing with a new tablet 0d7a01108a7042148334c054995cba3b
I20260807 13:38:58.940680 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:58.940901 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:58.941509 23578 raft_consensus.cc:2354] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4.
I20260807 13:38:58.942266 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "356c6b3e51454d418acaa9be70bb9689" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:58.875357 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:58.880322 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 196027us
I20260807 13:38:58.944128 23582 raft_consensus.cc:2379] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 3: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:58.943405 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:58.897454 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:58.899545 25031 raft_consensus.cc:482] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:58.736521 23737 tablet_bootstrap.cc:492] T 39707c5d97164544b9f5c03db41181c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:58.933110 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
W20260807 13:38:58.937317 23532 leader_election.cc:334] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 2.803s (SENT)
I20260807 13:38:58.935396 23675 raft_consensus.cc:3037] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:58.950997 23577 raft_consensus.cc:2379] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 3: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:58.939059 24863 raft_consensus.cc:729] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:58.951844 25093 raft_consensus.cc:686] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:58.952526 23737 ts_tablet_manager.cc:1397] T 39707c5d97164544b9f5c03db41181c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.597s user 0.017s sys 0.013s
I20260807 13:38:58.952719 23633 leader_election.cc:302] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:58.954021 23572 raft_consensus.cc:1226] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [term 4 LEADER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4. Ops: []
I20260807 13:38:58.954805 23581 raft_consensus.cc:2454] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:38:58.955251 23633 leader_election.cc:302] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:58.957413 25055 raft_consensus.cc:2781] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:38:58.958065 25055 raft_consensus.cc:686] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:58.957998 25093 consensus_queue.cc:237] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.954888 25031 raft_consensus.cc:504] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.957436 25041 raft_consensus.cc:2781] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:38:58.960260 23578 raft_consensus.cc:1261] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:58.961478 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:58.936014 24732 raft_consensus.cc:686] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:58.964167 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:58.964986 23577 raft_consensus.cc:1226] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 5. Current term is 6. Ops: []
I20260807 13:38:58.965194 23681 raft_consensus.cc:2454] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 6.
I20260807 13:38:58.945043 24881 raft_consensus.cc:482] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:58.967736 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:58.968513 23571 raft_consensus.cc:3037] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Advancing to term 6
@ 0x7fc698464980 (unknown) at ??:0
I20260807 13:38:58.974318 23571 raft_consensus.cc:2454] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 6.
I20260807 13:38:58.942279 23469 raft_consensus.cc:2454] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:38:58.978215 23571 raft_consensus.cc:1226] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [term 5 LEADER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 4. Current term is 5. Ops: []
W20260807 13:38:58.979851 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 45691.1us
I20260807 13:38:58.982620 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:58.982946 23578 raft_consensus.cc:1226] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 5 LEADER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 4. Current term is 5. Ops: []
I20260807 13:38:58.939498 24948 raft_consensus.cc:504] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.985872 23577 raft_consensus.cc:1226] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 2. Current term is 3. Ops: []
I20260807 13:38:58.986989 23430 leader_election.cc:302] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
W20260807 13:38:58.991317 25095 log.cc:924] Time spent T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.067s user 0.000s sys 0.001s
I20260807 13:38:58.992166 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:58.992561 23578 raft_consensus.cc:1261] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:38:58.998566 23571 raft_consensus.cc:1261] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:38:59.002666 23739 raft_consensus.cc:348] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.959136 25055 consensus_queue.cc:237] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.008543 23582 raft_consensus.cc:1226] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:58.967634 24647 consensus_queue.cc:1035] T a42b974d289d402ea12744b7caf94ae8 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260807 13:38:59.012959 23578 raft_consensus.cc:1261] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:38:59.007629 23739 raft_consensus.cc:374] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:59.016105 23739 raft_consensus.cc:729] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:59.017084 23739 consensus_queue.cc:260] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.988495 25041 raft_consensus.cc:686] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:59.002439 25058 raft_consensus.cc:2741] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260807 13:38:58.995919 24873 raft_consensus.cc:504] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.975955 24881 raft_consensus.cc:504] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.020282 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:59.012959 23572 raft_consensus.cc:1261] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260807 13:38:59.022184 25098 log.cc:924] Time spent T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.056s user 0.002s sys 0.000s
I20260807 13:38:59.029141 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:59.029702 24732 consensus_queue.cc:237] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.030934 23430 leader_election.cc:302] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:38:59.040508 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "608f7e63bc4648e0890e5f601c52736c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:59.031253 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:59.041361 23480 raft_consensus.cc:3037] T 608f7e63bc4648e0890e5f601c52736c P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:59.036405 23737 raft_consensus.cc:348] T 39707c5d97164544b9f5c03db41181c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.041925 23737 raft_consensus.cc:374] T 39707c5d97164544b9f5c03db41181c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:59.042351 23737 raft_consensus.cc:729] T 39707c5d97164544b9f5c03db41181c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:59.042263 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220c24fa0c52459182e1e89c74331f3b" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:59.046046 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:59.043469 23737 consensus_queue.cc:260] T 39707c5d97164544b9f5c03db41181c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:58.977872 24863 consensus_queue.cc:260] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.045042 25028 raft_consensus.cc:3032] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:59.061447 23737 ts_tablet_manager.cc:1428] T 39707c5d97164544b9f5c03db41181c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.109s user 0.008s sys 0.000s
I20260807 13:38:59.062287 25109 raft_consensus.cc:482] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:59.069219 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 46543.2us
I20260807 13:38:59.069644 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:59.073012 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:59.073487 23478 raft_consensus.cc:2362] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3. Re-sending same reply.
I20260807 13:38:59.068426 23480 raft_consensus.cc:2454] T 608f7e63bc4648e0890e5f601c52736c P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:38:59.048640 23672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 450) took 2276 ms. Trace:
I20260807 13:38:59.053896 24903 raft_consensus.cc:2781] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:38:59.093781 23737 tablet_bootstrap.cc:492] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:59.109236 23739 ts_tablet_manager.cc:1428] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.177s user 0.007s sys 0.003s
I20260807 13:38:59.057969 24948 leader_election.cc:288] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:38:59.114614 23532 leader_election.cc:334] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 1.843s (SENT)
I20260807 13:38:59.075984 24863 raft_consensus.cc:3037] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:59.062989 25028 raft_consensus.cc:729] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:59.079958 23677 raft_consensus.cc:1226] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260807 13:38:59.118682 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4996c3c52ccc41b9a8da11ca747a8e6a" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:59.080559 24903 raft_consensus.cc:482] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:38:59.123819 23430 leader_election.cc:302] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
W20260807 13:38:59.124498 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 63083.4us
I20260807 13:38:59.125003 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:59.139415 23684 raft_consensus.cc:1226] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 5. Current term is 6. Ops: []
I20260807 13:38:59.135385 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:59.135556 25028 consensus_queue.cc:260] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.139779 23633 leader_election.cc:302] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:59.139820 23577 raft_consensus.cc:2379] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 5: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:59.139478 23739 tablet_bootstrap.cc:492] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
I20260807 13:38:59.141227 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:59.077927 25109 raft_consensus.cc:504] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.140753 24903 raft_consensus.cc:3037] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:59.124068 24830 raft_consensus.cc:482] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:38:59.187561 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:59.189637 23478 raft_consensus.cc:2379] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:59.062597 25110 consensus_queue.cc:1035] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260807 13:38:59.167428 25058 raft_consensus.cc:2726] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:38:59.180804 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:59.196461 23480 raft_consensus.cc:2362] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 5. Re-sending same reply.
I20260807 13:38:59.182924 24881 leader_election.cc:288] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:59.183792 24873 leader_election.cc:288] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
W20260807 13:38:59.184238 25106 log.cc:924] Time spent T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.152s user 0.002s sys 0.003s
I20260807 13:38:59.139716 25041 consensus_queue.cc:237] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.202554 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:59.167853 23475 raft_consensus.cc:2362] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3. Re-sending same reply.
I20260807 13:38:59.170639 23675 raft_consensus.cc:2454] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
I20260807 13:38:59.194322 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:59.200001 25028 raft_consensus.cc:3037] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:59.231400 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:59.231874 23674 raft_consensus.cc:3037] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:59.234318 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:59.194447 24830 raft_consensus.cc:504] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.077852 23672 rpcz_store.cc:276] 0807 13:38:56.768884 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:38:58.296841 (+1527957us) service_pool.cc:227] Handling call
0807 13:38:58.297359 (+ 518us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:38:58.330455 (+ 33096us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:38:58.330517 (+ 62us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:38:58.331596 (+ 1079us) log.cc:842] Serialized 52 byte log entry
0807 13:38:58.516642 (+185046us) spinlock_profiling.cc:243] Waited 9.15 ms on lock 0x7b1800329800. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc69dfd68b1 00007fc69dfe3661 00007fc695104f96 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc69dfd68b1 00007fc69dfe3661 00007fc695119345 00007fc69df50a39
0807 13:38:58.659559 (+142917us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b1800329800. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc69dfd68b1 00007fc69dfe3661 00007fc695119345 00007fc69df50a39 00007fc6951368bb 00007fc695134cbf 00007fc695136e22 00007fc697ce05bb 00007fc697ce6063 00007fc697ce6411 00007fc6980335cf
0807 13:38:58.893472 (+233913us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:38:58.898736 (+ 5264us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:38:58.901224 (+ 2488us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:38:59.022480 (+121256us) raft_consensus.cc:1671] finished
0807 13:38:59.022500 (+ 20us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:38:59.045293 (+ 22793us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10857,"raft.queue_time_us":19321,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":8514,"spinlock_wait_cycles":24310784,"thread_start_us":221885,"threads_started":1,"wal-append.queue_time_us":566376}
I20260807 13:38:59.256992 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:59.269284 23475 raft_consensus.cc:2379] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 6: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
W20260807 13:38:59.270253 25086 log.cc:924] Time spent T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.542s user 0.003s sys 0.002s
I20260807 13:38:59.293251 23469 raft_consensus.cc:1261] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:59.296375 23737 tablet_bootstrap.cc:654] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
W20260807 13:38:59.300350 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 185755us
I20260807 13:38:59.304684 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "356c6b3e51454d418acaa9be70bb9689" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:38:59.305627 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 189806us
I20260807 13:38:59.306730 25058 raft_consensus.cc:482] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
@ 0x7fc691a59e87 gsignal at ??:0
I20260807 13:38:59.307276 25058 raft_consensus.cc:504] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.309438 25058 leader_election.cc:288] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:59.310228 25058 raft_consensus.cc:482] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:59.310848 25058 raft_consensus.cc:504] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.312989 25058 leader_election.cc:288] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:59.313982 23430 leader_election.cc:398] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Vote denied by peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363) with higher term. Message: Invalid argument: T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4.
I20260807 13:38:59.315919 23430 leader_election.cc:302] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:59.317131 25058 raft_consensus.cc:2726] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:59.320051 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:59.320508 23430 leader_election.cc:302] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
W20260807 13:38:59.304315 23533 leader_election.cc:341] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:59.323403 23533 leader_election.cc:302] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:59.330387 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a3da79d3b0447cbc19c4f28279e134" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:59.331252 23478 raft_consensus.cc:2362] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1. Re-sending same reply.
W20260807 13:38:59.336380 23532 leader_election.cc:334] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 1.980s (SENT)
I20260807 13:38:59.328722 25028 raft_consensus.cc:2781] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:38:59.330004 25058 raft_consensus.cc:2726] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:38:59.337821 25028 raft_consensus.cc:686] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [term 6 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:59.338835 25028 consensus_queue.cc:237] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.339996 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:59.337008 23478 raft_consensus.cc:1261] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 3 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260807 13:38:59.322320 23674 raft_consensus.cc:2454] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:38:59.349022 23480 raft_consensus.cc:3032] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:38:59.349479 23480 raft_consensus.cc:729] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:59.350286 23480 consensus_queue.cc:260] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.351809 23480 raft_consensus.cc:3037] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:38:59.353453 25031 leader_election.cc:288] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:59.356272 25046 raft_consensus.cc:3032] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:38:59.356379 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220c24fa0c52459182e1e89c74331f3b" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:59.356796 25046 raft_consensus.cc:729] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:59.364849 23480 raft_consensus.cc:1261] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260807 13:38:59.365907 23532 leader_election.cc:334] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 1.629s (SENT)
W20260807 13:38:59.366678 23532 leader_election.cc:334] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 2.001s (SENT)
I20260807 13:38:59.367020 23532 leader_election.cc:302] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
W20260807 13:38:59.367669 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 47434.2us
I20260807 13:38:59.367457 25046 consensus_queue.cc:260] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.372139 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6ae70649fa43bba8052b66977418f5" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:59.375784 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:59.377211 23478 raft_consensus.cc:3037] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:38:59.371198 25046 raft_consensus.cc:3037] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:38:59.378973 25031 raft_consensus.cc:2726] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 13:38:59.378245 23532 leader_election.cc:334] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 2.203s (SENT)
W20260807 13:38:59.383551 25100 log.cc:924] Time spent T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.441s user 0.005s sys 0.000s
W20260807 13:38:59.416002 23532 leader_election.cc:334] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 1.701s (SENT)
I20260807 13:38:59.416306 23430 leader_election.cc:302] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:59.416466 23532 leader_election.cc:302] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:59.371274 24903 raft_consensus.cc:504] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.421504 23478 raft_consensus.cc:2454] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 6.
I20260807 13:38:59.425793 23430 leader_election.cc:302] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:59.422489 25058 raft_consensus.cc:2726] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:38:59.427872 25033 raft_consensus.cc:2726] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:38:59.421545 25028 raft_consensus.cc:2726] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:59.431666 23478 raft_consensus.cc:1261] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:38:59.433451 23430 leader_election.cc:302] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:59.438630 23737 tablet_bootstrap.cc:492] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:38:59.439236 23737 ts_tablet_manager.cc:1397] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.358s user 0.036s sys 0.030s
W20260807 13:38:59.440160 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 288294us
W20260807 13:38:59.441820 23631 leader_election.cc:334] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 1.669s (SENT)
I20260807 13:38:59.443697 25033 raft_consensus.cc:2726] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:38:59.448340 23478 raft_consensus.cc:1261] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260807 13:38:59.451871 24903 leader_election.cc:288] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:59.452699 24903 consensus_queue.cc:1035] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260807 13:38:59.460887 25092 log.cc:924] Time spent T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.527s user 0.002s sys 0.003s
I20260807 13:38:59.444355 25033 raft_consensus.cc:482] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:59.470750 25033 raft_consensus.cc:504] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:59.472931 23415 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Tablet 11eba6f59d7f4541873d69ef88a0ad93 (table test-workload [id=6c3159b450c749628fd57db2251c593c]) was not created within the allowed timeout. Replacing with a new tablet 566a7784d04c469483a0a06b376eb089
I20260807 13:38:59.476478 23478 raft_consensus.cc:1261] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260807 13:38:59.476863 23478 pending_rounds.cc:76] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613: Aborting all ops after (but not including) 0
I20260807 13:38:59.476994 23478 pending_rounds.cc:97] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260807 13:38:59.477216 23478 raft_consensus.cc:2866] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:38:59.455329 25109 leader_election.cc:288] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
W20260807 13:38:59.495391 25087 log.cc:924] Time spent T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.666s user 0.003s sys 0.007s
W20260807 13:38:59.496960 25113 log.cc:924] Time spent T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.301s user 0.000s sys 0.006s
W20260807 13:38:59.498139 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 54597.1us
W20260807 13:38:59.505820 25130 log.cc:924] Time spent T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.066s user 0.000s sys 0.001s
I20260807 13:38:59.511392 23739 tablet_bootstrap.cc:654] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:59.515683 25033 leader_election.cc:288] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:59.518220 23533 leader_election.cc:302] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:59.519150 23533 leader_election.cc:302] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:59.520117 23533 leader_election.cc:398] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: Vote denied by peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765) with higher term. Message: Invalid argument: T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 5. Current term is 6.
I20260807 13:38:59.520391 23533 leader_election.cc:401] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260807 13:38:59.520290 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faff067df57c4de49e89824bbc248751" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:59.520582 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:59.521528 24948 raft_consensus.cc:2726] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765) with higher term. Message: Invalid argument: T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 5. Current term is 6.
I20260807 13:38:59.521486 23475 raft_consensus.cc:2379] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 2: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:38:59.522778 25026 consensus_queue.cc:1046] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:59.521443 25028 raft_consensus.cc:2781] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:38:59.529434 23475 raft_consensus.cc:3032] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:38:59.529906 23475 raft_consensus.cc:729] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:59.529757 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "608f7e63bc4648e0890e5f601c52736c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:38:59.530622 23480 raft_consensus.cc:2362] T 608f7e63bc4648e0890e5f601c52736c P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2. Re-sending same reply.
I20260807 13:38:59.522140 25031 raft_consensus.cc:2781] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:38:59.534286 23737 raft_consensus.cc:348] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.537081 23737 raft_consensus.cc:374] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:59.535194 23480 raft_consensus.cc:1226] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3. Ops: []
I20260807 13:38:59.537408 23737 raft_consensus.cc:729] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:38:59.528839 23430 leader_election.cc:398] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363) with higher term. Message: Invalid argument: T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4.
W20260807 13:38:59.541733 23631 leader_election.cc:334] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 2.150s (SENT)
I20260807 13:38:59.542625 25109 raft_consensus.cc:482] T 39707c5d97164544b9f5c03db41181c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:59.544821 25109 raft_consensus.cc:504] T 39707c5d97164544b9f5c03db41181c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:59.564543 23415 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Tablet 95c5e5bf2dd94ffc98d4ac0c6876c02e (table test-workload [id=6c3159b450c749628fd57db2251c593c]) was not created within the allowed timeout. Replacing with a new tablet 508c989e13ca4c47b5e2982478c5d328
I20260807 13:38:59.538874 23737 consensus_queue.cc:260] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:59.565539 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 425845us
I20260807 13:38:59.547274 24948 raft_consensus.cc:3032] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:38:59.531113 23475 consensus_queue.cc:260] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.569029 24830 leader_election.cc:288] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:59.569183 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:59.569877 23679 raft_consensus.cc:3037] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:59.570418 25109 leader_election.cc:288] T 39707c5d97164544b9f5c03db41181c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:59.570607 25031 raft_consensus.cc:686] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [term 4 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:59.571604 25031 consensus_queue.cc:237] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.573025 25033 raft_consensus.cc:482] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:59.573527 25033 raft_consensus.cc:504] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.575445 25033 leader_election.cc:288] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:59.575956 24931 raft_consensus.cc:2781] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:38:59.576568 24931 raft_consensus.cc:686] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:59.577469 24931 consensus_queue.cc:237] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:38:59.570461 23415 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Tablet e20c3c18eb474ef5b19f3300b13b17c3 (table test-workload [id=6c3159b450c749628fd57db2251c593c]) was not created within the allowed timeout. Replacing with a new tablet e6d26fd195cb4bf4bd91ba45a72f87ac
W20260807 13:38:59.580124 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 51425.8us
I20260807 13:38:59.584020 23679 raft_consensus.cc:2454] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4.
I20260807 13:38:59.588419 23671 raft_consensus.cc:1261] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:38:59.590746 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:59.593559 23681 raft_consensus.cc:2379] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 2: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:38:59.598312 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:59.598944 23674 raft_consensus.cc:2379] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 3: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:38:59.567767 24948 raft_consensus.cc:729] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
@ 0x7fc691a5b7f1 abort at ??:0
@ 0x2a0007 __interceptor_abort at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:263
I20260807 13:38:59.601557 23681 raft_consensus.cc:1226] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 LEADER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 2. Current term is 3. Ops: []
I20260807 13:38:59.631536 24830 consensus_queue.cc:1035] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260807 13:38:59.632408 24948 consensus_queue.cc:260] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.633092 23681 raft_consensus.cc:1261] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:38:59.602380 23737 ts_tablet_manager.cc:1428] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.163s user 0.003s sys 0.005s
I20260807 13:38:59.598047 25133 consensus_queue.cc:1046] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260807 13:38:59.613973 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4996c3c52ccc41b9a8da11ca747a8e6a" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:59.592865 25033 consensus_queue.cc:1046] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260807 13:38:59.615372 25134 consensus_queue.cc:1046] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:38:59.615929 24903 consensus_queue.cc:1046] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:38:59.618080 25048 consensus_queue.cc:1035] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:38:59.619185 23475 raft_consensus.cc:3037] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:59.619732 23430 leader_election.cc:302] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:59.603401 23675 raft_consensus.cc:1226] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 5. Current term is 6. Ops: [5.2-5.2]
W20260807 13:38:59.621670 23415 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Tablet 220c24fa0c52459182e1e89c74331f3b (table test-workload [id=6c3159b450c749628fd57db2251c593c]) was not created within the allowed timeout. Replacing with a new tablet dd8a99f8a43a4481a51b4d339f14bfdc
I20260807 13:38:59.624516 23680 raft_consensus.cc:1261] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:59.625008 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:59.625350 23684 raft_consensus.cc:1226] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4. Ops: []
I20260807 13:38:59.627708 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:59.629778 23631 leader_election.cc:302] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:59.630262 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:59.634102 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:59.639566 23681 raft_consensus.cc:1261] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:38:59.669734 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faff067df57c4de49e89824bbc248751" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:59.670573 23582 raft_consensus.cc:2454] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 0.
I20260807 13:38:59.678417 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e552e0aa3f4433858116fa31ee8458" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:59.688587 23737 tablet_bootstrap.cc:492] T b078a19f38494b04ad11b14d98ec4bca P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:38:59.689515 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:38:59.693768 23631 leader_election.cc:302] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:59.699522 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:38:59.699780 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9fcdd060ef64874a8719c95b2325942" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:59.669314 24931 raft_consensus.cc:2726] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:38:59.650342 24519 consensus_queue.cc:1035] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.050s
I20260807 13:38:59.687738 25031 consensus_queue.cc:1035] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
W20260807 13:38:59.723832 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 44027.4us
I20260807 13:38:59.699401 24805 raft_consensus.cc:482] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:59.725200 23415 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Tablet 8b6d649ae21a41c9b6723944d7036688 (table test-workload [id=6c3159b450c749628fd57db2251c593c]) was not created within the allowed timeout. Replacing with a new tablet 23e06eb23c7549ca833574823dc2f8a1
I20260807 13:38:59.684324 25109 raft_consensus.cc:482] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:38:59.713078 23581 raft_consensus.cc:1261] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260807 13:38:59.716703 23407 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:38:59.722082 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:59.723990 25048 raft_consensus.cc:2726] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:38:59.692780 24948 raft_consensus.cc:3037] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:59.669167 25046 consensus_queue.cc:1035] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260807 13:38:59.702674 23677 raft_consensus.cc:1226] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:38:59.633131 25119 consensus_queue.cc:1035] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.073s
I20260807 13:38:59.752133 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:38:59.748715 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 135129us
I20260807 13:38:59.707928 25028 raft_consensus.cc:686] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
W20260807 13:38:59.768635 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 148996us
W20260807 13:38:59.769724 25144 log.cc:924] Time spent T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.111s user 0.000s sys 0.003s
I20260807 13:38:59.702029 25026 consensus_queue.cc:1046] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260807 13:38:59.772581 23631 leader_election.cc:302] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters: 9ae273efd33642ad970ab8d1973917c1
W20260807 13:38:59.778504 23415 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Tablet 4996c3c52ccc41b9a8da11ca747a8e6a (table test-workload [id=6c3159b450c749628fd57db2251c593c]) was not created within the allowed timeout. Replacing with a new tablet 24d412bb0b294eeaabde57c850783dab
I20260807 13:38:59.773607 23430 leader_election.cc:302] T 608f7e63bc4648e0890e5f601c52736c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:38:59.794000 23737 tablet_bootstrap.cc:654] T b078a19f38494b04ad11b14d98ec4bca P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:38:59.793365 25028 consensus_queue.cc:237] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.796627 23631 leader_election.cc:302] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:59.797423 23739 tablet_bootstrap.cc:492] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:38:59.808991 23739 ts_tablet_manager.cc:1397] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 0.685s user 0.017s sys 0.014s
I20260807 13:38:59.800823 24519 raft_consensus.cc:3032] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:38:59.781361 24830 consensus_queue.cc:1035] T f4746a12996c4987a582df9f569b3c66 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260807 13:38:59.750383 25109 raft_consensus.cc:504] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.804939 25117 raft_consensus.cc:2781] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:38:59.746495 24805 raft_consensus.cc:504] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.812019 24519 raft_consensus.cc:729] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:38:59.819895 25134 raft_consensus.cc:3032] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:38:59.863246 25134 raft_consensus.cc:729] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:59.863445 25151 raft_consensus.cc:3032] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:38:59.864168 25134 consensus_queue.cc:260] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.865636 25134 raft_consensus.cc:3037] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:59.865861 25109 leader_election.cc:288] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:38:59.863962 25151 raft_consensus.cc:729] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:59.867481 25151 consensus_queue.cc:260] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.868943 25151 raft_consensus.cc:3037] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:59.869359 24805 leader_election.cc:288] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:59.870976 23572 raft_consensus.cc:2396] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
W20260807 13:38:59.871953 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 75411.6us
I20260807 13:38:59.873808 23631 leader_election.cc:302] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:59.863760 24519 consensus_queue.cc:260] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.877116 24519 raft_consensus.cc:3037] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:59.877454 24830 raft_consensus.cc:2726] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:38:59.877512 23631 leader_election.cc:302] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
W20260807 13:38:59.881088 23532 leader_election.cc:334] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 2.719s (SENT)
I20260807 13:38:59.881702 23532 leader_election.cc:302] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:59.885286 23739 raft_consensus.cc:348] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.886801 23631 leader_election.cc:302] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:59.886299 23739 raft_consensus.cc:374] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:38:59.888114 23739 raft_consensus.cc:729] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
I20260807 13:38:59.889094 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39707c5d97164544b9f5c03db41181c0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:59.889783 23681 raft_consensus.cc:2454] T 39707c5d97164544b9f5c03db41181c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:38:59.889923 23739 consensus_queue.cc:260] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.862515 24863 consensus_queue.cc:1035] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260807 13:38:59.893404 23533 leader_election.cc:302] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:38:59.932315 25025 raft_consensus.cc:482] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:38:59.915756 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 135501us
W20260807 13:38:59.903009 23532 leader_election.cc:334] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 1.540s (SENT)
I20260807 13:38:59.934774 23429 leader_election.cc:302] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:38:59.879683 25033 raft_consensus.cc:2726] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:38:59.935082 23532 leader_election.cc:302] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:38:59.938822 25093 raft_consensus.cc:3037] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:38:59.886003 24903 raft_consensus.cc:2726] T 608f7e63bc4648e0890e5f601c52736c P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:38:59.888818 24805 raft_consensus.cc:2726] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 13:38:59.947459 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 67983.7us
I20260807 13:38:59.889236 25117 raft_consensus.cc:686] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:38:59.914489 25110 raft_consensus.cc:2726] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:38:59.892590 24647 raft_consensus.cc:482] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
W20260807 13:38:59.950620 23429 leader_election.cc:341] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:38:59.933017 25025 raft_consensus.cc:504] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.941098 25026 raft_consensus.cc:2781] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:38:59.965308 25026 raft_consensus.cc:482] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:38:59.965927 25152 raft_consensus.cc:3032] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:38:59.966358 25152 raft_consensus.cc:729] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:59.966168 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39707c5d97164544b9f5c03db41181c0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:38:59.965751 25026 raft_consensus.cc:3037] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:38:59.968147 25139 raft_consensus.cc:2726] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:38:59.969365 23575 raft_consensus.cc:1261] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:59.940807 23475 raft_consensus.cc:1261] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:38:59.975484 23739 ts_tablet_manager.cc:1428] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.166s user 0.004s sys 0.010s
I20260807 13:38:59.980614 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b078a19f38494b04ad11b14d98ec4bca" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:38:59.981181 25025 leader_election.cc:288] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:38:59.982112 25158 consensus_queue.cc:1046] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260807 13:38:59.949604 25146 raft_consensus.cc:2781] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:38:59.971382 25154 consensus_queue.cc:1035] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.013s
I20260807 13:38:59.984257 23572 raft_consensus.cc:1261] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:38:59.987923 25152 consensus_queue.cc:260] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.989187 25133 raft_consensus.cc:3032] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:38:59.989614 25133 raft_consensus.cc:729] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:38:59.989965 25152 raft_consensus.cc:3037] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:38:59.990432 25133 consensus_queue.cc:260] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:38:59.993024 25133 raft_consensus.cc:3037] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:38:59.994652 23415 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Tablet b9fcdd060ef64874a8719c95b2325942 (table test-workload [id=6c3159b450c749628fd57db2251c593c]) was not created within the allowed timeout. Replacing with a new tablet cea21e439be142e588f12ee16d5f71b1
W20260807 13:39:00.013187 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 110244us
I20260807 13:39:00.018617 23631 leader_election.cc:302] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
W20260807 13:39:00.016628 23429 leader_election.cc:341] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:00.029475 23631 leader_election.cc:302] T 356c6b3e51454d418acaa9be70bb9689 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:00.031970 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:00.032917 23478 raft_consensus.cc:2362] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3. Re-sending same reply.
I20260807 13:39:00.005960 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:00.037030 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:38:59.976600 24647 raft_consensus.cc:504] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.038628 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b1542e790794928a76e4b29a1d7732b" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:00.067830 23480 raft_consensus.cc:2454] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:39:00.021763 25054 raft_consensus.cc:2726] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:39:00.021551 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:00.031025 24881 raft_consensus.cc:2726] T 356c6b3e51454d418acaa9be70bb9689 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:39:00.081235 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:00.031157 24830 raft_consensus.cc:2726] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 13:39:00.088063 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:00.078976 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39707c5d97164544b9f5c03db41181c0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:00.090030 23473 raft_consensus.cc:2379] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 1: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:39:00.090571 23672 raft_consensus.cc:1226] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:39:00.017184 25158 consensus_queue.cc:1225] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer 5e0ea5aa0c6d4846a5ccc9962342e17a log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260807 13:39:00.076715 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 303165us
I20260807 13:39:00.038312 23573 raft_consensus.cc:1261] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:39:00.067727 23572 raft_consensus.cc:2454] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 0.
W20260807 13:39:00.079267 23532 leader_election.cc:334] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 1.747s (SENT)
I20260807 13:39:00.080205 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:00.065663 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:00.025825 24903 consensus_queue.cc:1046] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260807 13:39:00.118703 23532 leader_election.cc:302] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:00.117364 25146 raft_consensus.cc:686] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 4 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
W20260807 13:39:00.130597 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 56231us
I20260807 13:39:00.130365 23633 leader_election.cc:302] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:39:00.137637 23572 raft_consensus.cc:1261] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260807 13:39:00.150028 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 57555.1us
I20260807 13:39:00.184746 23430 leader_election.cc:302] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:00.188273 23469 raft_consensus.cc:1261] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260807 13:39:00.189338 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 116605us
W20260807 13:39:00.191092 23532 leader_election.cc:334] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 1.649s (SENT)
I20260807 13:39:00.193405 23532 leader_election.cc:302] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:00.145139 23470 raft_consensus.cc:2362] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 6. Re-sending same reply.
I20260807 13:39:00.036036 25117 consensus_queue.cc:237] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.136858 25158 consensus_queue.cc:1046] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260807 13:39:00.183682 25031 raft_consensus.cc:2726] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:39:00.201959 23430 leader_election.cc:398] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363) with higher term. Message: Invalid argument: T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4.
I20260807 13:39:00.150816 24434 raft_consensus.cc:2781] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:39:00.211380 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:00.181669 25109 consensus_queue.cc:1035] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260807 13:39:00.224089 23479 raft_consensus.cc:2454] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
W20260807 13:39:00.226291 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 75719.3us
I20260807 13:39:00.229720 23430 leader_election.cc:302] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:00.208864 25046 raft_consensus.cc:2726] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260807 13:39:00.231848 23532 leader_election.cc:334] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 1.857s (SENT)
I20260807 13:39:00.232331 23532 leader_election.cc:302] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:00.131050 25175 consensus_queue.cc:1046] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.130s
I20260807 13:39:00.222975 25158 consensus_queue.cc:1225] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer 5e0ea5aa0c6d4846a5ccc9962342e17a log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260807 13:39:00.222776 23575 raft_consensus.cc:1261] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260807 13:39:00.240954 23481 raft_consensus.cc:3032] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:39:00.241493 23481 raft_consensus.cc:729] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:39:00.212117 24434 raft_consensus.cc:482] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:00.245599 23472 raft_consensus.cc:2454] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:39:00.246519 25163 raft_consensus.cc:482] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:00.247074 25163 raft_consensus.cc:504] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.249449 25163 leader_election.cc:288] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:00.252468 23674 raft_consensus.cc:1226] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 LEADER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 2. Current term is 3. Ops: []
I20260807 13:39:00.244648 23481 consensus_queue.cc:260] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:00.261513 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 110749us
I20260807 13:39:00.205303 24830 consensus_queue.cc:1035] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260807 13:39:00.263904 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:39:00.244735 25168 log.cc:924] Time spent T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.170s user 0.001s sys 0.000s
W20260807 13:39:00.273252 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 43592.1us
I20260807 13:39:00.243844 24434 raft_consensus.cc:3037] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:00.208159 25146 consensus_queue.cc:237] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.267297 25158 raft_consensus.cc:2726] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:39:00.274567 24647 leader_election.cc:288] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
@ 0x7fc6947cbdf4 google::LogMessage::SendToLog() at ??:0
I20260807 13:39:00.284382 25093 raft_consensus.cc:2726] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:39:00.299501 25162 log.cc:924] Time spent T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.258s user 0.000s sys 0.002s
I20260807 13:39:00.279525 23672 raft_consensus.cc:1261] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260807 13:39:00.293576 25178 raft_consensus.cc:2726] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:39:00.308154 23471 raft_consensus.cc:2454] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:39:00.278808 24903 consensus_queue.cc:1046] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260807 13:39:00.300918 25058 raft_consensus.cc:3032] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:39:00.311842 24903 consensus_queue.cc:1225] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Peer 5e0ea5aa0c6d4846a5ccc9962342e17a log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260807 13:39:00.312305 25058 raft_consensus.cc:729] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
W20260807 13:39:00.327613 25169 log.cc:924] Time spent T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.138s user 0.001s sys 0.000s
I20260807 13:39:00.330994 23430 leader_election.cc:302] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:00.333853 25152 raft_consensus.cc:2726] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260807 13:39:00.336418 25167 log.cc:924] Time spent T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.200s user 0.000s sys 0.001s
I20260807 13:39:00.337261 23430 leader_election.cc:302] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:00.331267 23475 raft_consensus.cc:2454] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4.
I20260807 13:39:00.320026 25058 consensus_queue.cc:260] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.325023 25026 raft_consensus.cc:504] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.356642 25058 raft_consensus.cc:3037] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:00.357847 25026 leader_election.cc:288] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:00.358589 23582 raft_consensus.cc:2354] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2.
I20260807 13:39:00.354147 25133 consensus_queue.cc:1046] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260807 13:39:00.360169 25133 consensus_queue.cc:1225] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer 9ae273efd33642ad970ab8d1973917c1 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260807 13:39:00.350826 25175 consensus_queue.cc:1225] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer 5e0ea5aa0c6d4846a5ccc9962342e17a log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260807 13:39:00.347862 25152 raft_consensus.cc:2781] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election won for term 3
W20260807 13:39:00.369783 25170 log.cc:924] Time spent T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.145s user 0.001s sys 0.000s
I20260807 13:39:00.372327 23737 tablet_bootstrap.cc:492] T b078a19f38494b04ad11b14d98ec4bca P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:39:00.372191 23430 leader_election.cc:302] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:00.373035 23737 ts_tablet_manager.cc:1397] T b078a19f38494b04ad11b14d98ec4bca P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 0.685s user 0.011s sys 0.012s
I20260807 13:39:00.374719 25152 raft_consensus.cc:686] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:39:00.377632 25157 raft_consensus.cc:2726] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 13:39:00.378986 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 145800us
I20260807 13:39:00.387971 25048 consensus_queue.cc:1035] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260807 13:39:00.390388 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 127393us
W20260807 13:39:00.392555 23415 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Tablet 356c6b3e51454d418acaa9be70bb9689 (table test-workload [id=6c3159b450c749628fd57db2251c593c]) was not created within the allowed timeout. Replacing with a new tablet 2d4dd3ca60c94d7e891841088eb8f765
W20260807 13:39:00.393631 23631 leader_election.cc:341] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:00.394085 24434 raft_consensus.cc:504] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:00.394960 23415 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Tablet 05a3da79d3b0447cbc19c4f28279e134 (table test-workload [id=6c3159b450c749628fd57db2251c593c]) was not created within the allowed timeout. Replacing with a new tablet 46cd5d7fc0cd4f06aa175ad4406c7845
I20260807 13:39:00.397691 25187 consensus_queue.cc:1035] T 28395e0788e4418291f95845e9d5e793 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:39:00.385560 25040 consensus_queue.cc:1035] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260807 13:39:00.395262 23631 leader_election.cc:302] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters: 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:00.408612 23481 raft_consensus.cc:3037] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:00.401126 24732 raft_consensus.cc:482] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:00.410682 24732 raft_consensus.cc:504] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.412009 25119 raft_consensus.cc:2781] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:39:00.412904 24863 raft_consensus.cc:3032] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:39:00.399858 25109 consensus_queue.cc:1035] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260807 13:39:00.412933 24732 leader_election.cc:288] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:00.414652 25186 consensus_queue.cc:1035] T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260807 13:39:00.399698 24434 leader_election.cc:288] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:00.417256 25030 consensus_queue.cc:1046] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:39:00.418480 25054 raft_consensus.cc:3032] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:39:00.400125 25171 raft_consensus.cc:3032] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:39:00.418890 25054 raft_consensus.cc:729] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:00.419111 25171 raft_consensus.cc:729] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:39:00.419903 25119 raft_consensus.cc:686] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:00.420104 25171 consensus_queue.cc:260] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.421010 25119 consensus_queue.cc:237] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.421778 25171 raft_consensus.cc:3037] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:39:00.413364 24863 raft_consensus.cc:729] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
@ 0x7fc6947cc9a0 google::LogMessage::Flush() at ??:0
I20260807 13:39:00.423611 24863 consensus_queue.cc:260] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.424561 25054 consensus_queue.cc:260] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.425741 24863 raft_consensus.cc:3037] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:00.426340 25054 raft_consensus.cc:3037] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:00.402801 25152 consensus_queue.cc:237] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:00.436196 23415 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Tablet faff067df57c4de49e89824bbc248751 (table test-workload [id=6c3159b450c749628fd57db2251c593c]) was not created within the allowed timeout. Replacing with a new tablet f40430392f094845a0d657f677860f4d
I20260807 13:39:00.441713 23481 raft_consensus.cc:1261] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260807 13:39:00.444324 25165 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260807 13:39:00.445354 25187 consensus_queue.cc:1035] T a1569622b874437badb8e59e749fe7db P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260807 13:39:00.448941 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 168448us
I20260807 13:39:00.449041 23430 leader_election.cc:302] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:00.452625 23680 raft_consensus.cc:1261] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260807 13:39:00.461640 23415 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Tablet b078a19f38494b04ad11b14d98ec4bca (table test-workload [id=6c3159b450c749628fd57db2251c593c]) was not created within the allowed timeout. Replacing with a new tablet c9b09df756c14aa29e17459696a886a1
I20260807 13:39:00.464243 23631 leader_election.cc:302] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters: 9ae273efd33642ad970ab8d1973917c1
W20260807 13:39:00.465353 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 84974.7us
W20260807 13:39:00.467375 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 239394us
W20260807 13:39:00.468089 23532 leader_election.cc:334] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 1.864s (SENT)
I20260807 13:39:00.469075 23430 leader_election.cc:302] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:00.473692 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39707c5d97164544b9f5c03db41181c0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:00.480374 25154 consensus_queue.cc:1035] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:39:00.481076 23631 leader_election.cc:302] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters: 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:00.463546 24434 consensus_queue.cc:1035] T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260807 13:39:00.482565 25157 raft_consensus.cc:2726] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:39:00.483631 25163 consensus_queue.cc:1035] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260807 13:39:00.465652 25165 raft_consensus.cc:482] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:00.506605 25165 raft_consensus.cc:504] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.488071 23430 leader_election.cc:302] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:00.474134 25155 raft_consensus.cc:2726] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:00.469877 25175 raft_consensus.cc:2726] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:39:00.465596 25187 consensus_queue.cc:1035] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260807 13:39:00.475109 25186 raft_consensus.cc:2781] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election won for term 3
W20260807 13:39:00.499918 23415 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Tablet ea6ae70649fa43bba8052b66977418f5 (table test-workload [id=6c3159b450c749628fd57db2251c593c]) was not created within the allowed timeout. Replacing with a new tablet f6cf62903437494c9280c9bf34653cb1
I20260807 13:39:00.498931 23633 leader_election.cc:302] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:00.512768 23631 leader_election.cc:302] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters: 9ae273efd33642ad970ab8d1973917c1
W20260807 13:39:00.515789 23532 leader_election.cc:334] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 3.139s (SENT)
W20260807 13:39:00.517225 23415 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Tablet 39707c5d97164544b9f5c03db41181c0 (table test-workload [id=6c3159b450c749628fd57db2251c593c]) was not created within the allowed timeout. Replacing with a new tablet 02cac2e1f00446668f33a2bf5fbbd4de
W20260807 13:39:00.526809 23415 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Tablet 46e552e0aa3f4433858116fa31ee8458 (table test-workload [id=6c3159b450c749628fd57db2251c593c]) was not created within the allowed timeout. Replacing with a new tablet 19ee3f9a953c4bbd889fc7001a63fec1
I20260807 13:39:00.501152 23737 raft_consensus.cc:348] T b078a19f38494b04ad11b14d98ec4bca P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.530197 23737 raft_consensus.cc:374] T b078a19f38494b04ad11b14d98ec4bca P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:00.530638 23737 raft_consensus.cc:729] T b078a19f38494b04ad11b14d98ec4bca P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:39:00.532531 25031 raft_consensus.cc:482] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:00.533317 25031 raft_consensus.cc:504] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.510174 23675 raft_consensus.cc:3037] T 39707c5d97164544b9f5c03db41181c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 2
W20260807 13:39:00.539953 23415 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Tablet 7cd369f3fbdf4b61a5fd1e85690c9ba4 (table test-workload [id=6c3159b450c749628fd57db2251c593c]) was not created within the allowed timeout. Replacing with a new tablet 1bef6ef007eb4dd18759fb406e70535c
I20260807 13:39:00.531692 23737 consensus_queue.cc:260] T b078a19f38494b04ad11b14d98ec4bca P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.509698 25165 leader_election.cc:288] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:00.516230 24830 raft_consensus.cc:2781] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:39:00.529399 25157 raft_consensus.cc:2726] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:39:00.542850 23430 leader_election.cc:302] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:00.557363 23481 raft_consensus.cc:1261] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:39:00.560583 23472 raft_consensus.cc:1261] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:39:00.563135 23681 raft_consensus.cc:1261] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:39:00.570770 23737 ts_tablet_manager.cc:1428] T b078a19f38494b04ad11b14d98ec4bca P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.197s user 0.008s sys 0.000s
I20260807 13:39:00.516041 24732 consensus_queue.cc:1035] T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260807 13:39:00.537256 25186 raft_consensus.cc:686] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
W20260807 13:39:00.574009 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 58283.8us
W20260807 13:39:00.576040 23532 leader_election.cc:334] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 1.825s (SENT)
I20260807 13:39:00.545740 24434 raft_consensus.cc:2726] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:39:00.546075 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:00.554740 24647 raft_consensus.cc:2781] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:39:00.580024 23737 tablet_bootstrap.cc:492] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:39:00.562412 25093 consensus_queue.cc:1035] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260807 13:39:00.581007 25165 raft_consensus.cc:2726] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260807 13:39:00.581842 23415 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Tablet 2b1542e790794928a76e4b29a1d7732b (table test-workload [id=6c3159b450c749628fd57db2251c593c]) was not created within the allowed timeout. Replacing with a new tablet e2a4ce7bb4d64b8596158d5ac194e4a9
I20260807 13:39:00.581919 23633 leader_election.cc:302] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
W20260807 13:39:00.586150 23532 leader_election.cc:334] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 1.883s (SENT)
I20260807 13:39:00.552882 24830 raft_consensus.cc:482] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:00.485476 25156 consensus_queue.cc:1035] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260807 13:39:00.577956 24881 consensus_queue.cc:1035] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260807 13:39:00.599977 24948 raft_consensus.cc:482] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:00.601929 24948 raft_consensus.cc:504] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.602491 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b1542e790794928a76e4b29a1d7732b" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:00.603293 23469 raft_consensus.cc:2454] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 0.
I20260807 13:39:00.607389 23481 raft_consensus.cc:1261] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260807 13:39:00.607856 23481 pending_rounds.cc:76] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613: Aborting all ops after (but not including) 0
I20260807 13:39:00.608088 23481 pending_rounds.cc:97] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260807 13:39:00.608345 23481 raft_consensus.cc:2866] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260807 13:39:00.589393 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 46665.6us
I20260807 13:39:00.609247 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "608f7e63bc4648e0890e5f601c52736c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:00.610527 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:39:00.588243 25216 log.cc:924] Time spent T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.093s user 0.002s sys 0.000s
I20260807 13:39:00.630594 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:39:00.631454 23532 leader_election.cc:334] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 2.013s (SENT)
I20260807 13:39:00.633000 23532 leader_election.cc:302] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:00.631567 23469 raft_consensus.cc:2454] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 5.
W20260807 13:39:00.642653 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 60803.1us
I20260807 13:39:00.585983 24647 raft_consensus.cc:482] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:00.598158 24830 raft_consensus.cc:3037] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:00.587587 25031 leader_election.cc:288] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:00.621518 24948 leader_election.cc:288] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:39:00.649580 23532 leader_election.cc:334] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 1.545s (SENT)
I20260807 13:39:00.651753 23631 leader_election.cc:302] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:00.653079 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faff067df57c4de49e89824bbc248751" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:00.654011 23479 raft_consensus.cc:3037] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:00.657204 23481 raft_consensus.cc:1261] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:00.574677 25155 consensus_queue.cc:1035] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260807 13:39:00.646318 25139 raft_consensus.cc:2726] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:39:00.649078 24647 raft_consensus.cc:3037] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:00.656244 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:00.675927 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:00.676031 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:00.675817 25230 consensus_queue.cc:1035] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:39:00.677470 23577 raft_consensus.cc:1261] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:39:00.677527 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:00.678135 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:00.678279 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4996c3c52ccc41b9a8da11ca747a8e6a" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:00.679378 23571 raft_consensus.cc:1203] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 3.2->[4.3-4.3] Dedup: 4.3->[]
I20260807 13:39:00.692564 23571 raft_consensus.cc:1226] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 13:39:00.651863 24732 raft_consensus.cc:2781] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:39:00.674165 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:00.694813 23582 raft_consensus.cc:2362] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 5. Re-sending same reply.
I20260807 13:39:00.651437 25048 consensus_queue.cc:1035] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260807 13:39:00.684052 23580 raft_consensus.cc:2396] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:39:00.659364 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a3da79d3b0447cbc19c4f28279e134" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:00.639622 25119 consensus_queue.cc:1035] T 98d96e350af14393a80eeb2702230747 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260807 13:39:00.669790 24948 raft_consensus.cc:482] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:00.711251 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:00.690285 25157 raft_consensus.cc:482] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:00.666900 25109 raft_consensus.cc:2781] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:39:00.696130 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:00.694525 24732 raft_consensus.cc:482] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:39:00.692905 23532 leader_election.cc:334] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 2.004s (SENT)
I20260807 13:39:00.698985 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e552e0aa3f4433858116fa31ee8458" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:00.704149 23479 raft_consensus.cc:2454] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:39:00.631631 25200 consensus_queue.cc:1035] T 173a6c34d23a480793ef93a33940fa0f P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
W20260807 13:39:00.731354 23532 leader_election.cc:334] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 2.037s (SENT)
I20260807 13:39:00.731681 23582 raft_consensus.cc:1226] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 1. Current term is 2. Ops: []
I20260807 13:39:00.731827 23532 leader_election.cc:302] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:00.710101 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:00.695504 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:00.691032 25033 raft_consensus.cc:482] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:00.720189 24948 raft_consensus.cc:504] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.701922 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9fcdd060ef64874a8719c95b2325942" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:00.730599 23572 raft_consensus.cc:2454] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:39:00.740118 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b078a19f38494b04ad11b14d98ec4bca" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:39:00.738875 23532 leader_election.cc:334] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 2.278s (SENT)
I20260807 13:39:00.740793 23580 raft_consensus.cc:2454] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 0.
I20260807 13:39:00.741163 23532 leader_election.cc:302] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:00.743471 25139 raft_consensus.cc:2726] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:39:00.689962 24873 consensus_queue.cc:1035] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260807 13:39:00.722364 25109 raft_consensus.cc:482] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:00.720568 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:00.723407 25175 raft_consensus.cc:482] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:00.733675 24732 raft_consensus.cc:3037] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:00.734181 25156 raft_consensus.cc:2726] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:39:00.719959 25110 consensus_queue.cc:1035] T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260807 13:39:00.751678 25033 raft_consensus.cc:504] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.758256 25109 raft_consensus.cc:3037] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:39:00.719820 25213 consensus_queue.cc:1035] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.114s
I20260807 13:39:00.783506 25187 consensus_queue.cc:1035] T ea6ae70649fa43bba8052b66977418f5 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:39:00.769733 25033 leader_election.cc:288] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:00.694881 25186 consensus_queue.cc:237] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.801910 23737 tablet_bootstrap.cc:654] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:00.724035 25157 raft_consensus.cc:504] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.838608 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:00.859251 25155 raft_consensus.cc:482] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:00.773062 25175 raft_consensus.cc:504] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.876626 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6ae70649fa43bba8052b66977418f5" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:00.877564 25054 raft_consensus.cc:482] T b078a19f38494b04ad11b14d98ec4bca P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:00.878374 25054 raft_consensus.cc:504] T b078a19f38494b04ad11b14d98ec4bca P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.881196 25054 leader_election.cc:288] T b078a19f38494b04ad11b14d98ec4bca P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:00.881693 25046 raft_consensus.cc:482] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:00.882323 25046 raft_consensus.cc:504] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.891958 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:00.892776 23684 raft_consensus.cc:2454] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:39:00.893462 25175 leader_election.cc:288] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:00.894305 23533 leader_election.cc:302] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:39:00.895267 25139 raft_consensus.cc:2781] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:39:00.895697 25139 raft_consensus.cc:482] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:00.896029 25139 raft_consensus.cc:3037] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:00.902146 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cd369f3fbdf4b61a5fd1e85690c9ba4" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:00.910167 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:00.911481 23473 raft_consensus.cc:2379] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
W20260807 13:39:00.913056 23429 leader_election.cc:341] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:39:00.916551 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:00.922447 23675 raft_consensus.cc:2454] T 39707c5d97164544b9f5c03db41181c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:39:00.923210 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:00.924060 23473 raft_consensus.cc:2362] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3. Re-sending same reply.
I20260807 13:39:00.924482 23533 leader_election.cc:302] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:39:00.882869 25155 raft_consensus.cc:504] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.925315 24805 raft_consensus.cc:2781] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:39:00.925916 24805 raft_consensus.cc:686] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:39:00.926911 24805 consensus_queue.cc:237] T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.929931 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:00.931354 23671 raft_consensus.cc:2454] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:39:00.932734 23533 leader_election.cc:302] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:39:00.936659 25031 raft_consensus.cc:2781] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:39:00.937176 25031 raft_consensus.cc:482] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:00.937584 25031 raft_consensus.cc:3037] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:00.871006 24948 leader_election.cc:288] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:00.942318 23575 raft_consensus.cc:2454] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4.
I20260807 13:39:00.896508 25157 leader_election.cc:288] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:00.925297 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:00.949416 23473 raft_consensus.cc:2396] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:39:00.950909 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:00.952908 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cd369f3fbdf4b61a5fd1e85690c9ba4" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:00.953826 23473 raft_consensus.cc:2454] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:39:00.954330 23574 raft_consensus.cc:2454] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 6.
I20260807 13:39:00.927341 25155 leader_election.cc:288] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:00.965039 24830 raft_consensus.cc:504] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:00.901472 25046 leader_election.cc:288] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:01.000509 23672 raft_consensus.cc:1226] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4. Ops: []
I20260807 13:39:00.955097 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:01.012050 25033 raft_consensus.cc:482] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:01.012905 25033 raft_consensus.cc:504] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:01.016726 23671 raft_consensus.cc:1261] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
@ 0x7fc6947d1adb google::LogMessageFatal::~LogMessageFatal() at ??:0
I20260807 13:39:01.023159 25033 leader_election.cc:288] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:01.026391 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:00.999550 24830 leader_election.cc:288] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:01.024503 25165 consensus_queue.cc:1035] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260807 13:39:01.056794 23532 leader_election.cc:334] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 2.781s (SENT)
I20260807 13:39:01.029683 25046 consensus_queue.cc:1046] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260807 13:39:01.031095 24732 raft_consensus.cc:504] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:01.040396 25109 raft_consensus.cc:504] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:01.104712 24647 raft_consensus.cc:504] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:01.101661 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 415622us
I20260807 13:39:01.049726 23473 raft_consensus.cc:2396] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260807 13:39:01.107105 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 438063us
W20260807 13:39:01.140568 23532 leader_election.cc:334] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 2.873s (SENT)
I20260807 13:39:01.142879 23532 leader_election.cc:302] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
W20260807 13:39:01.146613 23407 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:39:01.147850 23633 leader_election.cc:398] T 39707c5d97164544b9f5c03db41181c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Vote denied by peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363) with higher term. Message: Invalid argument: T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2.
I20260807 13:39:01.148299 23633 leader_election.cc:401] T 39707c5d97164544b9f5c03db41181c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:39:01.149181 25155 raft_consensus.cc:482] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:01.149718 23676 raft_consensus.cc:1226] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4. Ops: []
I20260807 13:39:01.149843 25155 raft_consensus.cc:504] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:01.165488 24948 raft_consensus.cc:3032] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:39:01.166218 24948 raft_consensus.cc:729] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:39:01.168987 24647 leader_election.cc:288] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:01.170696 24873 raft_consensus.cc:2726] T 39707c5d97164544b9f5c03db41181c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election lost for term 1. Reason: Vote denied by peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363) with higher term. Message: Invalid argument: T 39707c5d97164544b9f5c03db41181c0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2.
I20260807 13:39:01.171730 25156 consensus_queue.cc:1046] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:39:01.172879 25156 raft_consensus.cc:3032] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:39:01.173287 25156 raft_consensus.cc:729] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:39:01.174305 25156 consensus_queue.cc:260] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:01.176059 25156 raft_consensus.cc:3037] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:01.177445 25109 leader_election.cc:288] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:01.179316 24732 leader_election.cc:288] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:01.182964 25031 raft_consensus.cc:504] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:01.187677 25155 leader_election.cc:288] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:01.157284 25139 raft_consensus.cc:504] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:01.189973 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:01.191485 25139 leader_election.cc:288] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:01.194120 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:01.195111 23676 raft_consensus.cc:3037] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:01.194651 24948 consensus_queue.cc:260] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:01.196359 24948 raft_consensus.cc:3037] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:01.208499 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:01.209951 23473 raft_consensus.cc:2379] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 5: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:39:01.226774 23631 leader_election.cc:302] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:01.227316 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:01.230224 25139 raft_consensus.cc:482] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:01.231082 25139 raft_consensus.cc:504] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:01.233457 24732 raft_consensus.cc:2781] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election won for term 1
W20260807 13:39:01.234575 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 77371.3us
I20260807 13:39:01.146394 25046 raft_consensus.cc:2726] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:39:01.240238 23676 raft_consensus.cc:2454] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:39:01.241454 23533 leader_election.cc:302] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:39:01.247160 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faff067df57c4de49e89824bbc248751" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:01.248050 23578 raft_consensus.cc:3037] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:01.240468 25155 raft_consensus.cc:482] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:01.249571 25155 raft_consensus.cc:504] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:01.251834 25025 raft_consensus.cc:2781] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:39:01.252573 25025 raft_consensus.cc:686] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:39:01.253654 25025 consensus_queue.cc:237] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:01.258129 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:01.234083 24732 raft_consensus.cc:686] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:01.238831 25031 leader_election.cc:288] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:39:01.277638 24931 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s user 0.017s sys 0.009s
I20260807 13:39:01.281275 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:39:01.286000 23429 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:33986 dropped due to backpressure. The service queue is full; it has 50 items.
I20260807 13:39:01.301438 23572 raft_consensus.cc:1261] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:39:01.306945 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:01.280987 25139 leader_election.cc:288] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:39:01.305168 24931 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s user 0.017s sys 0.010s
W20260807 13:39:01.351251 23532 leader_election.cc:334] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 3.084s (SENT)
I20260807 13:39:01.351830 23532 leader_election.cc:302] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:01.302837 25031 raft_consensus.cc:482] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:01.304057 25155 leader_election.cc:288] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:39:01.310755 23470 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.549s user 0.010s sys 0.029s
I20260807 13:39:01.300658 23429 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:33986 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 513)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 518)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 524)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 514)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 443)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 533)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 539)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 447)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 510)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 432)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 433)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 508)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 526)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 531)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 436)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 540)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 541)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 542)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 449)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 450)
I20260807 13:39:01.325763 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b078a19f38494b04ad11b14d98ec4bca" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:39:01.375910 23470 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.614s user 0.011s sys 0.029s
I20260807 13:39:01.352535 23578 raft_consensus.cc:2454] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:39:01.376998 23430 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:33986 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 513)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 518)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 524)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 514)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 443)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 533)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 539)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 447)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 510)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 432)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 433)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 508)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 526)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 531)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 436)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 540)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 541)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 542)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 449)
I20260807 13:39:01.387034 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b078a19f38494b04ad11b14d98ec4bca" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:01.387823 23578 raft_consensus.cc:2454] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 0.
I20260807 13:39:01.375492 23429 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:33986 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 513)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 518)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 524)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 514)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 443)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 533)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 539)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 447)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 510)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 432)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 433)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 508)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 526)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 531)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 436)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 540)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 541)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 542)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 449)
I20260807 13:39:01.409286 23633 leader_election.cc:302] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:01.415114 23430 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:33986 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 513)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 518)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 524)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 514)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 443)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 533)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 539)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 447)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 510)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 432)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 433)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 508)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 526)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 531)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 436)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 540)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 541)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 542)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 446)
I20260807 13:39:01.376556 23473 raft_consensus.cc:2454] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 0.
I20260807 13:39:01.377326 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:01.434080 25235 consensus_queue.cc:1035] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:39:01.434872 23575 raft_consensus.cc:1261] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:01.387601 25139 raft_consensus.cc:482] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:01.429894 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:01.445066 23430 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:33986 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 513)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 518)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 524)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 514)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 443)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 533)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 539)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 447)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 510)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 432)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 433)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 508)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 526)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 531)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 436)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 540)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 541)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 542)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 444)
I20260807 13:39:01.409852 25155 raft_consensus.cc:2726] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:39:01.453524 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:01.378445 25031 raft_consensus.cc:504] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:01.455798 25139 raft_consensus.cc:504] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:01.458217 25031 leader_election.cc:288] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:01.458437 25139 leader_election.cc:288] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:01.383885 24732 consensus_queue.cc:237] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:01.421633 25048 raft_consensus.cc:2726] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:39:01.462700 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:01.455416 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b078a19f38494b04ad11b14d98ec4bca" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:01.450605 23573 raft_consensus.cc:2454] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 5.
I20260807 13:39:01.492172 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b1542e790794928a76e4b29a1d7732b" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:01.470358 23473 raft_consensus.cc:2454] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:39:01.507531 23571 raft_consensus.cc:2454] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4.
W20260807 13:39:01.535403 23471 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s user 0.020s sys 0.079s
W20260807 13:39:01.529670 23472 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.757s user 0.015s sys 0.037s
I20260807 13:39:01.537201 23575 raft_consensus.cc:3037] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:39:01.570629 23577 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.795s user 0.007s sys 0.049s
W20260807 13:39:01.552117 23471 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.782s user 0.020s sys 0.079s
W20260807 13:39:01.566864 23472 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s user 0.015s sys 0.038s
W20260807 13:39:01.580683 23480 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.833s user 0.008s sys 0.038s
W20260807 13:39:01.581120 23480 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.833s user 0.008s sys 0.038s
W20260807 13:39:01.582285 23481 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.829s user 0.006s sys 0.040s
W20260807 13:39:01.582832 23481 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.830s user 0.007s sys 0.040s
W20260807 13:39:01.575800 23577 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s user 0.007s sys 0.049s
W20260807 13:39:01.600930 23681 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.845s user 0.015s sys 0.035s
W20260807 13:39:01.601424 23681 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.846s user 0.015s sys 0.035s
W20260807 13:39:01.608484 23479 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.820s user 0.024s sys 0.023s
W20260807 13:39:01.609071 23479 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.821s user 0.024s sys 0.023s
I20260807 13:39:01.609531 23430 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:33986 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 524)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 514)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 443)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 533)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 547)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 539)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 447)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 510)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 432)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 433)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 508)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 526)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 531)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 436)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 540)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 541)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 542)
I20260807 13:39:01.579150 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
W20260807 13:39:01.623728 23469 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.916s user 0.021s sys 0.029s
W20260807 13:39:01.624289 23469 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.917s user 0.021s sys 0.029s
I20260807 13:39:01.615280 23430 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:33972 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 524)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 514)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 443)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 533)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 547)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 539)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 447)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 510)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 432)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 433)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 508)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 526)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 531)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 436)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 540)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 541)
W20260807 13:39:01.689218 23680 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.053s user 0.022s sys 0.057s
W20260807 13:39:01.689853 23680 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.054s user 0.023s sys 0.057s
W20260807 13:39:01.602572 25186 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s user 0.013s sys 0.064s
W20260807 13:39:01.699941 25186 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s user 0.013s sys 0.064s
I20260807 13:39:01.603183 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:01.689917 23573 raft_consensus.cc:3037] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:39:01.708587 23430 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:33972 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 524)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 514)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 443)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 533)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 547)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 539)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 447)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 510)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 432)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 433)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 508)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 526)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 531)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 436)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 540)
W20260807 13:39:01.713145 23478 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.984s user 0.037s sys 0.109s
W20260807 13:39:01.771903 23478 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.042s user 0.037s sys 0.110s
W20260807 13:39:01.716372 23737 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.815s user 0.016s sys 0.051s
W20260807 13:39:01.807739 23737 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.910s user 0.017s sys 0.053s
W20260807 13:39:01.808533 23415 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.749s user 0.016s sys 0.069s
W20260807 13:39:01.745849 24948 consensus_meta.cc:287] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.549s user 0.013s sys 0.002s
W20260807 13:39:01.810298 23415 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.751s user 0.017s sys 0.069s
W20260807 13:39:01.786727 24805 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.856s user 0.020s sys 0.034s
W20260807 13:39:01.837329 23684 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s user 0.002s sys 0.018s
W20260807 13:39:01.751668 23475 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.989s user 0.023s sys 0.034s
W20260807 13:39:01.852475 23684 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s user 0.003s sys 0.019s
I20260807 13:39:01.808701 23478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 414) took 1247 ms. Trace:
I20260807 13:39:01.811830 23430 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:33972 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 524)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 514)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 443)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 533)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 547)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 539)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 447)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 510)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 432)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 433)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 508)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 526)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 531)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 436)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 538)
W20260807 13:39:01.832648 24805 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.902s user 0.021s sys 0.034s
I20260807 13:39:01.853991 23478 rpcz_store.cc:276] 0807 13:39:00.561029 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:00.562654 (+ 1625us) service_pool.cc:227] Handling call
0807 13:39:00.605114 (+ 42460us) spinlock_profiling.cc:243] Waited 7.3 ms on lock 0x7b5800003398. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:39:00.605316 (+ 202us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:00.605646 (+ 330us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:00.605675 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:00.606139 (+ 464us) log.cc:842] Serialized 26 byte log entry
0807 13:39:00.684482 (+ 78343us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:39:01.772565 (+1088083us) log.cc:842] Serialized 14 byte log entry
0807 13:39:01.772858 (+ 293us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:01.772960 (+ 102us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:01.773016 (+ 56us) raft_consensus.cc:1671] finished
0807 13:39:01.808267 (+ 35251us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:01.808567 (+ 300us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":26450,"prepare.queue_time_us":83419,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":54185,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":2578,"spinlock_wait_cycles":16782208,"thread_start_us":1120821,"threads_started":2,"wal-append.queue_time_us":149375}
I20260807 13:39:01.886214 23472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 429) took 1293 ms. Trace:
W20260807 13:39:01.876330 23475 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.116s user 0.026s sys 0.034s
W20260807 13:39:01.917228 24830 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s user 0.019s sys 0.036s
W20260807 13:39:01.957224 24830 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.803s user 0.020s sys 0.037s
I20260807 13:39:01.902486 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b1542e790794928a76e4b29a1d7732b" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:01.953943 23472 rpcz_store.cc:276] 0807 13:39:00.592606 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:00.724577 (+131971us) service_pool.cc:227] Handling call
0807 13:39:00.725138 (+ 561us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:00.747716 (+ 22578us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:00.747759 (+ 43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:00.758309 (+ 10550us) log.cc:842] Serialized 26 byte log entry
0807 13:39:01.593887 (+835578us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:01.601796 (+ 7909us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:01.620734 (+ 18938us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:01.885954 (+265220us) raft_consensus.cc:1671] finished
0807 13:39:01.885983 (+ 29us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:01.886143 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3842,"raft.queue_time_us":25474,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":6448,"thread_start_us":808239,"threads_started":1,"wal-append.queue_time_us":1124265}
I20260807 13:39:01.958770 23581 raft_consensus.cc:2454] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4.
W20260807 13:39:01.995251 23677 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.975s user 0.040s sys 0.051s
W20260807 13:39:01.995827 23677 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.976s user 0.040s sys 0.051s
W20260807 13:39:01.993350 23572 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.672s user 0.003s sys 0.015s
I20260807 13:39:01.963035 23473 raft_consensus.cc:3037] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:01.941149 23430 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:33972 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 524)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 514)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 443)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 533)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 547)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 539)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 447)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 510)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 432)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 433)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 508)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 526)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 531)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 436)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 442)
W20260807 13:39:01.998088 23572 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.677s user 0.004s sys 0.016s
I20260807 13:39:01.994483 25165 raft_consensus.cc:482] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:39:02.000260 24647 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s user 0.000s sys 0.019s
I20260807 13:39:02.023118 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 425) took 1453 ms. Trace:
W20260807 13:39:02.027624 23533 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.701s user 0.005s sys 0.017s
W20260807 13:39:02.027983 23533 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.701s user 0.005s sys 0.017s
I20260807 13:39:02.025493 23480 rpcz_store.cc:276] 0807 13:39:00.570126 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:00.690464 (+120338us) service_pool.cc:227] Handling call
0807 13:39:00.710622 (+ 20158us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:00.746861 (+ 36239us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:00.746917 (+ 56us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:00.747514 (+ 597us) log.cc:842] Serialized 26 byte log entry
0807 13:39:00.909788 (+162274us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b48000c2358. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc69cf067f1 00007fc69cefd8e7 00007fc69cefd77a 00007fc69cff195f 00007fc69cff1627 00007fc69d005b2c 00007fc69d005ad8 00007fc69d005a58 00007fc69d005a13 00007fc69d004cbc 00007fc69bf86be6
0807 13:39:01.581764 (+671976us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:01.622346 (+ 40582us) log.cc:842] Serialized 14 byte log entry
0807 13:39:01.622567 (+ 221us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:01.622643 (+ 76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:02.020819 (+398176us) raft_consensus.cc:1671] finished
0807 13:39:02.022807 (+ 1988us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:02.023024 (+ 217us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":16653,"prepare.queue_time_us":162959,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":32392,"raft.run_cpu_time_us":2016,"raft.run_wall_time_us":217534,"spinlock_wait_cycles":6377728,"thread_start_us":833777,"threads_started":1,"wal-append.queue_time_us":1139529}
I20260807 13:39:02.031826 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.032940 23478 raft_consensus.cc:2354] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 5. Current term is 6.
I20260807 13:39:02.033474 23478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 525) took 1012 ms. Trace:
I20260807 13:39:02.033880 23478 rpcz_store.cc:276] 0807 13:39:01.021140 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.021576 (+1000436us) service_pool.cc:227] Handling call
0807 13:39:02.033391 (+ 11815us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:39:02.025496 24647 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.787s user 0.000s sys 0.020s
W20260807 13:39:02.025914 25243 log.cc:924] Time spent T b9fcdd060ef64874a8719c95b2325942 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.193s user 0.000s sys 0.001s
I20260807 13:39:02.038791 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.041281 23478 raft_consensus.cc:2379] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:39:02.041858 23478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 514) took 1265 ms. Trace:
I20260807 13:39:02.042284 23478 rpcz_store.cc:276] 0807 13:39:00.776097 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.034848 (+1258751us) service_pool.cc:227] Handling call
0807 13:39:02.041807 (+ 6959us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:02.043483 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
W20260807 13:39:02.024284 23631 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.645s user 0.000s sys 0.022s
I20260807 13:39:02.046003 23478 raft_consensus.cc:2379] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:39:02.047390 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:02.048074 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.049187 23480 raft_consensus.cc:2396] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260807 13:39:02.049724 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 509) took 1291 ms. Trace:
I20260807 13:39:02.050108 23480 rpcz_store.cc:276] 0807 13:39:00.758463 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.031034 (+1272571us) service_pool.cc:227] Handling call
0807 13:39:02.049650 (+ 18616us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:39:02.050935 23631 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.671s user 0.000s sys 0.022s
W20260807 13:39:02.051407 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 676351us
I20260807 13:39:02.059208 23478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 512) took 1293 ms. Trace:
I20260807 13:39:02.057397 23631 leader_election.cc:302] T b078a19f38494b04ad11b14d98ec4bca P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:02.059854 23478 rpcz_store.cc:276] 0807 13:39:00.766166 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.043157 (+1276991us) service_pool.cc:227] Handling call
0807 13:39:02.059113 (+ 15956us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:39:02.041919 23580 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s user 0.068s sys 0.152s
W20260807 13:39:02.082754 23580 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s user 0.068s sys 0.153s
W20260807 13:39:02.082779 23633 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.669s user 0.024s sys 0.019s
I20260807 13:39:02.084287 23737 tablet_bootstrap.cc:492] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:39:02.038619 24830 raft_consensus.cc:482] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:02.085248 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:02.085465 23737 ts_tablet_manager.cc:1397] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 1.508s user 0.033s sys 0.057s
I20260807 13:39:02.084193 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:02.086131 23480 raft_consensus.cc:3037] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:02.055131 23429 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:33986 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 533)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 547)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 539)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 447)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 510)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 432)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 433)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 508)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 526)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 531)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 436)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 453)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 454)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 456)
I20260807 13:39:02.024020 25165 raft_consensus.cc:504] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:02.044787 23470 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s user 0.003s sys 0.019s
W20260807 13:39:02.083585 23633 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.670s user 0.024s sys 0.019s
W20260807 13:39:02.088886 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 675275us
W20260807 13:39:02.083097 23532 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.706s user 0.005s sys 0.024s
W20260807 13:39:02.089701 23532 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.713s user 0.005s sys 0.024s
W20260807 13:39:02.090265 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 739028us
I20260807 13:39:02.088898 23429 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:33986 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 533)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 547)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 539)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 447)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 510)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 432)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 433)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 508)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 526)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 531)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 436)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 453)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 454)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 456)
I20260807 13:39:02.076535 25155 raft_consensus.cc:482] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
W20260807 13:39:02.087589 24873 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.825s user 0.039s sys 0.084s
W20260807 13:39:02.094256 23470 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s user 0.004s sys 0.019s
I20260807 13:39:02.087738 24931 raft_consensus.cc:2781] T b078a19f38494b04ad11b14d98ec4bca P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:39:02.107988 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:02.109148 23478 raft_consensus.cc:2396] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:39:02.106560 24931 raft_consensus.cc:482] T b078a19f38494b04ad11b14d98ec4bca P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:02.110155 24931 raft_consensus.cc:3037] T b078a19f38494b04ad11b14d98ec4bca P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:39:02.103475 24873 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.841s user 0.039s sys 0.085s
W20260807 13:39:02.114106 23532 leader_election.cc:334] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 2.016s (SENT)
W20260807 13:39:02.112159 23578 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s user 0.011s sys 0.018s
W20260807 13:39:02.115006 23578 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s user 0.011s sys 0.019s
I20260807 13:39:02.117097 23480 raft_consensus.cc:2454] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4.
W20260807 13:39:02.111600 25249 log.cc:924] Time spent T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.152s user 0.000s sys 0.001s
I20260807 13:39:02.114585 23532 leader_election.cc:302] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:02.119439 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:02.122551 23478 raft_consensus.cc:2354] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 5. Current term is 6.
W20260807 13:39:02.116130 25245 log.cc:924] Time spent T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.171s user 0.001s sys 0.001s
I20260807 13:39:02.093859 24830 raft_consensus.cc:504] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:02.123867 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:39:02.120666 23574 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s user 0.006s sys 0.024s
W20260807 13:39:02.125506 23532 leader_election.cc:334] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 2.052s (SENT)
I20260807 13:39:02.113258 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.105120 25155 raft_consensus.cc:504] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:02.127213 23478 raft_consensus.cc:2379] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
W20260807 13:39:02.118132 23577 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s user 0.005s sys 0.025s
I20260807 13:39:02.122031 24805 raft_consensus.cc:482] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:02.130020 23532 leader_election.cc:302] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
W20260807 13:39:02.141644 23577 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.539s user 0.005s sys 0.026s
I20260807 13:39:02.128432 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.146354 23480 raft_consensus.cc:2396] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:39:02.147195 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.148136 23478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 527) took 1108 ms. Trace:
I20260807 13:39:02.148518 23478 rpcz_store.cc:276] 0807 13:39:01.039456 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.141343 (+1101887us) service_pool.cc:227] Handling call
0807 13:39:02.148069 (+ 6726us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:02.149581 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:02.151763 23478 raft_consensus.cc:2396] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260807 13:39:02.129745 23574 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s user 0.007s sys 0.025s
I20260807 13:39:02.152390 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 520) took 1293 ms. Trace:
I20260807 13:39:02.153326 23480 rpcz_store.cc:276] 0807 13:39:00.858701 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.126338 (+1267637us) service_pool.cc:227] Handling call
0807 13:39:02.152329 (+ 25991us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:02.162987 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:02.163904 23478 raft_consensus.cc:3037] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:02.161726 23479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 431) took 1564 ms. Trace:
W20260807 13:39:02.156798 25231 log.cc:924] Time spent T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.161s user 0.001s sys 0.001s
W20260807 13:39:02.151463 25233 log.cc:924] Time spent T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.154s user 0.000s sys 0.001s
I20260807 13:39:02.165126 23479 rpcz_store.cc:276] 0807 13:39:00.596924 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:00.737408 (+140484us) service_pool.cc:227] Handling call
0807 13:39:00.737753 (+ 345us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:00.756308 (+ 18555us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:00.756330 (+ 22us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:00.756670 (+ 340us) log.cc:842] Serialized 26 byte log entry
0807 13:39:00.908056 (+151386us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b48000c2358. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc69cf067f1 00007fc69cefd8e7 00007fc69cefd77a 00007fc69cff195f 00007fc69cff1627 00007fc69d005b2c 00007fc69d005ad8 00007fc69d005a58 00007fc69d005a13 00007fc69d004cbc 00007fc69bf86be6
0807 13:39:01.609558 (+701502us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:39:01.609607 (+ 49us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:01.609686 (+ 79us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:02.155858 (+546172us) raft_consensus.cc:1671] finished
0807 13:39:02.155877 (+ 19us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:02.161645 (+ 5768us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18166,"raft.queue_time_us":18290,"raft.run_cpu_time_us":1803,"raft.run_wall_time_us":150359,"spinlock_wait_cycles":4212096,"thread_start_us":821261,"threads_started":1,"wal-append.queue_time_us":1130215}
I20260807 13:39:02.170331 23737 raft_consensus.cc:348] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:02.171344 23737 raft_consensus.cc:374] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:02.171725 23737 raft_consensus.cc:729] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:39:02.174607 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:02.175424 23480 raft_consensus.cc:2379] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:39:02.153609 23472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 524) took 1161 ms. Trace:
I20260807 13:39:02.176551 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:02.176522 23472 rpcz_store.cc:276] 0807 13:39:00.992377 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.104514 (+1112137us) service_pool.cc:227] Handling call
0807 13:39:02.151207 (+ 46693us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:02.177291 23479 raft_consensus.cc:3037] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:02.177932 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b1542e790794928a76e4b29a1d7732b" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.172559 23737 consensus_queue.cc:260] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:02.155009 23573 raft_consensus.cc:2454] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 6.
I20260807 13:39:02.184777 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.188262 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.189414 23480 raft_consensus.cc:2396] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260807 13:39:02.189769 23481 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s user 0.019s sys 0.020s
W20260807 13:39:02.191089 23481 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s user 0.019s sys 0.020s
I20260807 13:39:02.194396 23479 raft_consensus.cc:2454] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
I20260807 13:39:02.195838 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 515) took 1400 ms. Trace:
W20260807 13:39:02.197518 23582 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.811s user 0.007s sys 0.018s
W20260807 13:39:02.212931 23582 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.826s user 0.008s sys 0.018s
I20260807 13:39:02.196486 23480 rpcz_store.cc:276] 0807 13:39:00.795764 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.187840 (+1392076us) service_pool.cc:227] Handling call
0807 13:39:02.195753 (+ 7913us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:02.180670 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:02.218647 23478 raft_consensus.cc:2454] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4.
I20260807 13:39:02.220832 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.148222 24805 raft_consensus.cc:504] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:02.185295 25165 leader_election.cc:288] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:02.227149 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:02.228634 23480 raft_consensus.cc:2396] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:39:02.230235 25265 raft_consensus.cc:2726] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:02.231041 25265 consensus_queue.cc:1035] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:39:02.197391 25025 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.745s user 0.009s sys 0.027s
I20260807 13:39:02.235723 23737 ts_tablet_manager.cc:1428] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.150s user 0.010s sys 0.000s
I20260807 13:39:02.238296 23680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 527) took 1727 ms. Trace:
I20260807 13:39:02.224105 23471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 428) took 1632 ms. Trace:
I20260807 13:39:02.245703 24830 leader_election.cc:288] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:02.247229 23677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 535) took 1484 ms. Trace:
W20260807 13:39:02.255259 23428 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.545s user 0.018s sys 0.017s
I20260807 13:39:02.238726 23680 rpcz_store.cc:276] 0807 13:39:00.511393 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:00.511576 (+ 183us) service_pool.cc:227] Handling call
0807 13:39:00.511989 (+ 413us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:39:00.537982 (+ 25993us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:00.538029 (+ 47us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:39:00.553511 (+ 15482us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b2c000a2b08. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc696a42e11 00007fc696a52442 00007fc69809ac11 00007fc69805f58a 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772
0807 13:39:00.564195 (+ 10684us) log.cc:842] Serialized 52 byte log entry
0807 13:39:01.690388 (+1126193us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:01.690460 (+ 72us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:01.690561 (+ 101us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:02.237545 (+546984us) raft_consensus.cc:1671] finished
0807 13:39:02.237567 (+ 22us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:02.238224 (+ 657us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":35393,"raft.queue_time_us":29565,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":17197,"spinlock_wait_cycles":7899392,"thread_start_us":1054154,"threads_started":1,"wal-append.queue_time_us":1364206}
I20260807 13:39:02.223271 23479 raft_consensus.cc:2379] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:39:02.247786 23430 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:33972 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 562)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 560)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 563)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 447)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 565)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 572)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 510)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 574)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 567)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 530)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 570)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 432)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 433)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 508)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 526)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 531)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 436)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 453)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 454)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 559)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 561)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 568)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 573)
I20260807 13:39:02.255134 25269 raft_consensus.cc:2726] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:39:02.269361 23469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 427) took 1698 ms. Trace:
I20260807 13:39:02.250785 23737 tablet_bootstrap.cc:492] T 46e552e0aa3f4433858116fa31ee8458 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
W20260807 13:39:02.239180 25025 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s user 0.009s sys 0.028s
I20260807 13:39:02.250180 23472 raft_consensus.cc:2396] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260807 13:39:02.249432 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.262437 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.285688 23478 raft_consensus.cc:2379] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:39:02.287025 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.252724 23677 rpcz_store.cc:276] 0807 13:39:00.762739 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:00.763963 (+ 1224us) service_pool.cc:227] Handling call
0807 13:39:00.787874 (+ 23911us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:00.868482 (+ 80608us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:00.871292 (+ 2810us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:00.932321 (+ 61029us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b2c000a2b08. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc696a42e11 00007fc696a52442 00007fc69809ac11 00007fc69805f58a 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772
0807 13:39:00.932795 (+ 474us) log.cc:842] Serialized 26 byte log entry
0807 13:39:01.996358 (+1063563us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:01.996416 (+ 58us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:01.996529 (+ 113us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:02.246839 (+250310us) raft_consensus.cc:1671] finished
0807 13:39:02.246868 (+ 29us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:02.247158 (+ 290us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":24486,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":5789,"spinlock_wait_cycles":26470272,"thread_start_us":976308,"threads_started":1,"wal-append.queue_time_us":1234349}
W20260807 13:39:02.252728 25263 log.cc:924] Time spent T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.099s user 0.001s sys 0.000s
W20260807 13:39:02.255942 25246 log.cc:924] Time spent T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.308s user 0.003s sys 0.004s
I20260807 13:39:02.269806 23469 rpcz_store.cc:276] 0807 13:39:00.570843 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:00.688417 (+117574us) service_pool.cc:227] Handling call
0807 13:39:00.704076 (+ 15659us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:00.706861 (+ 2785us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:00.706903 (+ 42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:00.707408 (+ 505us) log.cc:842] Serialized 26 byte log entry
0807 13:39:01.624783 (+917375us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:39:01.624841 (+ 58us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:01.624933 (+ 92us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:02.269082 (+644149us) raft_consensus.cc:1671] finished
0807 13:39:02.269103 (+ 21us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:02.269283 (+ 180us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2390,"raft.queue_time_us":3604,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":10134,"thread_start_us":916907,"threads_started":1,"wal-append.queue_time_us":1239720}
W20260807 13:39:02.255822 23428 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.560s user 0.018s sys 0.018s
I20260807 13:39:02.295804 23480 raft_consensus.cc:2396] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:39:02.296234 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.297046 23478 raft_consensus.cc:2396] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260807 13:39:02.305709 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 539) took 1063 ms. Trace:
I20260807 13:39:02.305752 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.306198 23480 rpcz_store.cc:276] 0807 13:39:01.242571 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.236895 (+994324us) service_pool.cc:227] Handling call
0807 13:39:02.305639 (+ 68744us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:02.306998 23478 raft_consensus.cc:2379] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 5: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:39:02.307413 23478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 529) took 1239 ms. Trace:
I20260807 13:39:02.307715 23478 rpcz_store.cc:276] 0807 13:39:01.067716 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.305282 (+1237566us) service_pool.cc:227] Handling call
0807 13:39:02.307357 (+ 2075us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:02.309535 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:02.350381 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.365521 23469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 505) took 1633 ms. Trace:
I20260807 13:39:02.365988 23469 rpcz_store.cc:276] 0807 13:39:00.731707 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.304716 (+1573009us) service_pool.cc:227] Handling call
0807 13:39:02.365446 (+ 60730us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:02.352239 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.368211 23480 raft_consensus.cc:2454] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 5.
I20260807 13:39:02.367213 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:02.375927 23469 raft_consensus.cc:2379] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 5: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:39:02.356583 25155 leader_election.cc:288] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:02.359100 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 437) took 1063 ms. Trace:
I20260807 13:39:02.349257 23479 raft_consensus.cc:2354] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 2. Current term is 4.
W20260807 13:39:02.361307 23575 consensus_meta.cc:287] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.760s user 0.015s sys 0.000s
I20260807 13:39:02.308611 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.300130 25165 raft_consensus.cc:482] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:02.311497 23472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 544) took 1004 ms. Trace:
I20260807 13:39:02.376833 23681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 534) took 1667 ms. Trace:
I20260807 13:39:02.385864 23681 rpcz_store.cc:276] 0807 13:39:00.709383 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:00.709554 (+ 171us) service_pool.cc:227] Handling call
0807 13:39:00.709942 (+ 388us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:00.721251 (+ 11309us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:00.721296 (+ 45us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:00.731310 (+ 10014us) log.cc:842] Serialized 26 byte log entry
0807 13:39:01.601873 (+870563us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:01.601942 (+ 69us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:01.602033 (+ 91us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:02.168494 (+566461us) spinlock_profiling.cc:243] Waited 4.77 ms on lock 0x7b44000232cc. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc695049a95 00007fc69504a4b2 00007fc697cf2511 00007fc697cede1a 00007fc697ce1bee 00007fc697ce0f36 00007fc697ce0b58 00007fc697cea551 00007fc697cea509 00007fc697cea499
0807 13:39:02.362550 (+194056us) raft_consensus.cc:1671] finished
0807 13:39:02.362583 (+ 33us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:02.376740 (+ 14157us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2089,"raft.queue_time_us":14236,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":10968448,"thread_start_us":846339,"threads_started":1,"wal-append.queue_time_us":1149481}
I20260807 13:39:02.379417 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.380637 23469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 516) took 1584 ms. Trace:
I20260807 13:39:02.359601 24805 leader_election.cc:288] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:02.382987 23479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 517) took 1566 ms. Trace:
W20260807 13:39:02.372946 23571 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.739s user 0.002s sys 0.034s
I20260807 13:39:02.381822 23580 rpcz_store.cc:276] 0807 13:39:01.295587 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:01.295760 (+ 173us) service_pool.cc:227] Handling call
0807 13:39:01.314987 (+ 19227us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:01.317603 (+ 2616us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:01.317645 (+ 42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:01.326534 (+ 8889us) log.cc:842] Serialized 26 byte log entry
0807 13:39:02.083288 (+756754us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:39:02.083330 (+ 42us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:02.083418 (+ 88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:02.358827 (+275409us) raft_consensus.cc:1671] finished
0807 13:39:02.358849 (+ 22us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:02.359010 (+ 161us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11107,"raft.queue_time_us":2289,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":31691,"thread_start_us":674452,"threads_started":1,"wal-append.queue_time_us":884753}
I20260807 13:39:02.384984 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:02.425724 23480 raft_consensus.cc:2379] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 4: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
@ 0x7fc69e79380e kudu::TestWorkload::Setup() at ??:0
I20260807 13:39:02.424659 23684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 487) took 1296 ms. Trace:
I20260807 13:39:02.417815 25287 raft_consensus.cc:482] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:02.372390 25273 raft_consensus.cc:482] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:02.429683 23478 raft_consensus.cc:2354] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 5. Current term is 6.
@ 0x345a78 kudu::master::LeaderRebalancerTest::CreateWorkloadTable() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:109
I20260807 13:39:02.435820 23479 rpcz_store.cc:276] 0807 13:39:00.816310 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.309154 (+1492844us) service_pool.cc:227] Handling call
0807 13:39:02.382904 (+ 73750us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:39:02.436630 23571 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.803s user 0.002s sys 0.040s
I20260807 13:39:02.436758 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 532) took 1285 ms. Trace:
I20260807 13:39:02.437112 23480 rpcz_store.cc:276] 0807 13:39:01.141195 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.368904 (+1227709us) service_pool.cc:227] Handling call
0807 13:39:02.426276 (+ 57372us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:02.436643 23469 rpcz_store.cc:276] 0807 13:39:00.796097 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.366848 (+1570751us) service_pool.cc:227] Handling call
0807 13:39:02.380504 (+ 13656us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:02.427912 23684 rpcz_store.cc:276] 0807 13:39:01.128038 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:01.128225 (+ 187us) service_pool.cc:227] Handling call
0807 13:39:01.128660 (+ 435us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:01.129147 (+ 487us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:01.129187 (+ 40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:01.129753 (+ 566us) log.cc:842] Serialized 26 byte log entry
0807 13:39:01.853092 (+723339us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:01.853153 (+ 61us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:01.853264 (+ 111us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:02.424318 (+571054us) raft_consensus.cc:1671] finished
0807 13:39:02.424347 (+ 29us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:02.424576 (+ 229us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3001,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":7755,"thread_start_us":681274,"threads_started":1,"wal-append.queue_time_us":974990}
I20260807 13:39:02.439478 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:39:02.444017 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 346517us
W20260807 13:39:02.446661 23407 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:39:02.418529 23573 raft_consensus.cc:1261] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
@ 0x3424af kudu::master::LeaderRebalancerTest_AddTserver_Test::TestBody() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:411
I20260807 13:39:02.384311 23575 raft_consensus.cc:2454] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:39:02.459519 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:02.460278 23478 raft_consensus.cc:3037] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:39:02.463685 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.464365 23469 raft_consensus.cc:2454] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:39:02.464799 23577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 467) took 1784 ms. Trace:
W20260807 13:39:02.457610 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 330924us
I20260807 13:39:02.457866 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:02.470698 23480 raft_consensus.cc:2379] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:39:02.472023 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9fcdd060ef64874a8719c95b2325942" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.473546 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.385681 23472 rpcz_store.cc:276] 0807 13:39:01.304747 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.179289 (+874542us) service_pool.cc:227] Handling call
0807 13:39:02.309247 (+129958us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:02.480294 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.484491 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:02.503839 23479 raft_consensus.cc:2379] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:39:02.486642 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cd369f3fbdf4b61a5fd1e85690c9ba4" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:39:02.501435 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 350233us
W20260807 13:39:02.517328 23532 leader_election.cc:334] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 2.548s (SENT)
I20260807 13:39:02.518035 23532 leader_election.cc:302] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:02.521334 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e552e0aa3f4433858116fa31ee8458" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.436455 23473 raft_consensus.cc:2454] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:39:02.504570 23681 raft_consensus.cc:2454] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
W20260807 13:39:02.524515 23631 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:33986 dropped due to backpressure. The service queue is full; it has 50 items. [suppressed 63 similar messages]
I20260807 13:39:02.465195 23577 rpcz_store.cc:276] 0807 13:39:00.680541 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:00.735740 (+ 55199us) service_pool.cc:227] Handling call
0807 13:39:00.736108 (+ 368us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:39:00.736486 (+ 378us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:00.736513 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:39:00.751314 (+ 14801us) log.cc:842] Serialized 52 byte log entry
0807 13:39:01.584552 (+833238us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:39:02.145565 (+561013us) log.cc:842] Serialized 14 byte log entry
0807 13:39:02.464264 (+318699us) log.cc:842] Serialized 14 byte log entry
0807 13:39:02.464501 (+ 237us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:02.464570 (+ 69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:02.464612 (+ 42us) raft_consensus.cc:1671] finished
0807 13:39:02.464624 (+ 12us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:02.464739 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11807,"prepare.queue_time_us":834298,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":141431,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":8913,"thread_start_us":1662277,"threads_started":3,"wal-append.queue_time_us":1131134}
I20260807 13:39:02.522271 23469 raft_consensus.cc:2454] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:39:02.538101 23469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 535) took 1296 ms. Trace:
I20260807 13:39:02.538539 23469 rpcz_store.cc:276] 0807 13:39:01.241328 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.464954 (+1223626us) service_pool.cc:227] Handling call
0807 13:39:02.538040 (+ 73086us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:02.542251 23582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 443) took 1228 ms. Trace:
I20260807 13:39:02.456846 25276 raft_consensus.cc:482] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:02.429538 24931 raft_consensus.cc:504] T b078a19f38494b04ad11b14d98ec4bca P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:02.390090 25165 raft_consensus.cc:504] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:02.542834 23582 rpcz_store.cc:276] 0807 13:39:01.313610 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:01.313745 (+ 135us) service_pool.cc:227] Handling call
0807 13:39:01.353125 (+ 39380us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:01.365962 (+ 12837us) raft_consensus.cc:1520] Early marking committed up to index 1
0807 13:39:02.213363 (+847401us) log.cc:842] Serialized 14 byte log entry
0807 13:39:02.541781 (+328418us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:02.541850 (+ 69us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:02.541920 (+ 70us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:02.542012 (+ 92us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:02.542172 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1752,"prepare.queue_time_us":1005918,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"spinlock_wait_cycles":1065728,"thread_start_us":1152910,"threads_started":2}
I20260807 13:39:02.554759 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.556733 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 423) took 1987 ms. Trace:
I20260807 13:39:02.558475 23469 raft_consensus.cc:2454] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:39:02.559355 23469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 543) took 1315 ms. Trace:
W20260807 13:39:02.554458 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 456372us
I20260807 13:39:02.559804 23469 rpcz_store.cc:276] 0807 13:39:01.264286 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.539300 (+1275014us) service_pool.cc:227] Handling call
0807 13:39:02.559282 (+ 19982us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:02.561236 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "608f7e63bc4648e0890e5f601c52736c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.558379 23481 rpcz_store.cc:276] 0807 13:39:00.569446 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:00.681477 (+112031us) service_pool.cc:227] Handling call
0807 13:39:00.681771 (+ 294us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:00.681967 (+ 196us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:39:01.583322 (+901355us) log.cc:842] Serialized 14 byte log entry
0807 13:39:02.556367 (+973045us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:02.556424 (+ 57us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:02.556466 (+ 42us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:02.556529 (+ 63us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:02.556666 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":44356,"prepare.queue_time_us":81601,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"thread_start_us":1802809,"threads_started":3,"wal-append.queue_time_us":770836}
I20260807 13:39:02.562172 23469 raft_consensus.cc:2454] T 608f7e63bc4648e0890e5f601c52736c P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:39:02.563721 23631 leader_election.cc:302] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:02.479038 23575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 459) took 1037 ms. Trace:
I20260807 13:39:02.565728 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:02.571110 23479 raft_consensus.cc:2379] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:39:02.586534 23478 raft_consensus.cc:2454] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 6.
I20260807 13:39:02.587383 23478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 447) took 1316 ms. Trace:
I20260807 13:39:02.587769 23478 rpcz_store.cc:276] 0807 13:39:01.270807 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.459241 (+1188434us) service_pool.cc:227] Handling call
0807 13:39:02.587304 (+128063us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:02.452890 25273 raft_consensus.cc:504] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:02.429801 25287 raft_consensus.cc:504] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:02.697980 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 184259us
I20260807 13:39:02.653964 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.853039 23571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 450) took 1471 ms. Trace:
I20260807 13:39:02.631852 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.864243 23571 rpcz_store.cc:276] 0807 13:39:01.381444 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:01.554935 (+173491us) service_pool.cc:227] Handling call
0807 13:39:01.568327 (+ 13392us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:39:01.576745 (+ 8418us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:01.576793 (+ 48us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:39:01.583960 (+ 7167us) log.cc:842] Serialized 52 byte log entry
0807 13:39:02.437113 (+853153us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:02.437164 (+ 51us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:02.437238 (+ 74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:02.852735 (+415497us) raft_consensus.cc:1671] finished
0807 13:39:02.852760 (+ 25us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:02.852951 (+ 191us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":7865,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":3562,"thread_start_us":803594,"threads_started":1,"wal-append.queue_time_us":1059974}
W20260807 13:39:02.547235 23473 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 448) took 1274 ms (client timeout 1560 ms). Trace:
I20260807 13:39:02.521828 23573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 454) took 1138 ms. Trace:
I20260807 13:39:02.638228 23480 raft_consensus.cc:2396] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260807 13:39:02.655823 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:02.659422 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.865995 23478 raft_consensus.cc:2396] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260807 13:39:02.672907 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.945600 23479 raft_consensus.cc:2454] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:39:02.946283 23479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 554) took 1051 ms. Trace:
I20260807 13:39:02.946660 23479 rpcz_store.cc:276] 0807 13:39:01.894848 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.571769 (+676921us) service_pool.cc:227] Handling call
0807 13:39:02.946209 (+374440us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:02.911824 25299 raft_consensus.cc:482] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
W20260807 13:39:02.948308 25307 log.cc:924] Time spent T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.197s user 0.000s sys 0.000s
I20260807 13:39:02.948087 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.948908 23479 raft_consensus.cc:2454] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
W20260807 13:39:02.949136 25293 log.cc:924] Time spent T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.180s user 0.000s sys 0.001s
W20260807 13:39:02.614135 25244 log.cc:924] Time spent T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.054s user 0.000s sys 0.001s
I20260807 13:39:02.885913 23533 leader_election.cc:302] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:39:02.951059 23581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 451) took 1569 ms. Trace:
I20260807 13:39:02.951537 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.952445 23479 raft_consensus.cc:2454] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 5.
I20260807 13:39:02.951447 23581 rpcz_store.cc:276] 0807 13:39:01.382049 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.021829 (+639780us) service_pool.cc:227] Handling call
0807 13:39:02.022317 (+ 488us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:02.022796 (+ 479us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:02.022836 (+ 40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:02.025105 (+ 2269us) log.cc:842] Serialized 26 byte log entry
0807 13:39:02.430276 (+405171us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:39:02.430336 (+ 60us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:02.430447 (+ 111us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:02.950681 (+520234us) raft_consensus.cc:1671] finished
0807 13:39:02.950708 (+ 27us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:02.950874 (+ 166us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":706,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":3466,"thread_start_us":333412,"threads_started":1,"wal-append.queue_time_us":666945}
I20260807 13:39:02.953325 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.953998 23581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 462) took 1457 ms. Trace:
I20260807 13:39:02.954461 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.954375 23581 rpcz_store.cc:276] 0807 13:39:01.497159 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.953164 (+1456005us) service_pool.cc:227] Handling call
0807 13:39:02.953498 (+ 334us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:02.953673 (+ 175us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:02.953698 (+ 25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:02.953739 (+ 41us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:02.953783 (+ 44us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:02.953839 (+ 56us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:02.953942 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:39:02.886687 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 228060us
I20260807 13:39:02.570693 23575 rpcz_store.cc:276] 0807 13:39:01.441382 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:01.464772 (+ 23390us) service_pool.cc:227] Handling call
0807 13:39:02.463119 (+998347us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:02.656775 23582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 460) took 1195 ms. Trace:
I20260807 13:39:02.956753 23479 raft_consensus.cc:2454] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:39:02.568646 25276 raft_consensus.cc:504] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:02.765892 23572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 441) took 1455 ms. Trace:
I20260807 13:39:02.958731 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.959465 23481 raft_consensus.cc:2354] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4.
I20260807 13:39:02.797494 23737 tablet_bootstrap.cc:654] T 46e552e0aa3f4433858116fa31ee8458 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:02.941253 23429 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:33986 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 586)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 593)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 588)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 572)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 510)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 574)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 567)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 578)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 577)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 530)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 570)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 592)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 432)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 433)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 508)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 526)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 531)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 436)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 453)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 454)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 559)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 561)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 568)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 573)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 583)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 459)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 461)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 462)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 463)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 464)
I20260807 13:39:02.893793 23571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 461) took 1429 ms. Trace:
W20260807 13:39:02.960322 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 74520.2us
W20260807 13:39:02.714777 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 197484us
I20260807 13:39:02.249810 23471 rpcz_store.cc:276] 0807 13:39:00.591634 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:00.726280 (+134646us) service_pool.cc:227] Handling call
0807 13:39:00.726678 (+ 398us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:00.768707 (+ 42029us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:00.768747 (+ 40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:00.769311 (+ 564us) log.cc:842] Serialized 26 byte log entry
0807 13:39:01.583515 (+814204us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:01.593845 (+ 10330us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:01.696274 (+102429us) spinlock_profiling.cc:243] Waited 41.6 ms on lock 0x7b5400292a54. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:39:01.696351 (+ 77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:02.182910 (+486559us) raft_consensus.cc:1671] finished
0807 13:39:02.182937 (+ 27us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:02.222138 (+ 39201us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1253,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"spinlock_wait_cycles":95649664,"thread_start_us":808201,"threads_started":1,"wal-append.queue_time_us":1119689}
W20260807 13:39:02.734874 25288 log.cc:924] Time spent T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.142s user 0.000s sys 0.000s
I20260807 13:39:02.963824 23582 rpcz_store.cc:276] 0807 13:39:01.460967 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.558017 (+1097050us) service_pool.cc:227] Handling call
0807 13:39:02.656109 (+ 98092us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:02.656344 (+ 235us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:02.656381 (+ 37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:02.656434 (+ 53us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:02.656475 (+ 41us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:02.656547 (+ 72us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:02.656699 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:02.906265 23577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 456) took 1521 ms. Trace:
W20260807 13:39:02.892554 23430 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:33986 dropped due to backpressure. The service queue is full; it has 50 items. [suppressed 12 similar messages]
W20260807 13:39:02.697085 25281 log.cc:924] Time spent T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.238s user 0.000s sys 0.000s
W20260807 13:39:02.697616 25264 log.cc:924] Time spent T 8cd7bd21d1d04883878a334d64e518e3 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.333s user 0.000s sys 0.001s
W20260807 13:39:02.768373 25289 log.cc:924] Time spent T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.057s user 0.000s sys 0.000s
I20260807 13:39:02.968339 23572 rpcz_store.cc:276] 0807 13:39:01.310211 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:01.310352 (+ 141us) service_pool.cc:227] Handling call
0807 13:39:01.310773 (+ 421us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:02.004332 (+693559us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:02.004377 (+ 45us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:02.022364 (+ 17987us) log.cc:842] Serialized 26 byte log entry
0807 13:39:02.522905 (+500541us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:02.522941 (+ 36us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:02.523005 (+ 64us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:02.765591 (+242586us) raft_consensus.cc:1671] finished
0807 13:39:02.765620 (+ 29us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:02.765803 (+ 183us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1338,"raft.queue_time_us":6474,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":22635,"thread_start_us":1159425,"threads_started":2,"wal-append.queue_time_us":686023}
W20260807 13:39:02.991281 23532 leader_election.cc:334] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 3.339s (SENT)
I20260807 13:39:02.991973 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 536) took 1750 ms. Trace:
I20260807 13:39:03.010269 23481 rpcz_store.cc:276] 0807 13:39:01.241652 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.562216 (+1320564us) service_pool.cc:227] Handling call
0807 13:39:02.991908 (+429692us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:02.716269 25302 raft_consensus.cc:2726] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:39:02.991689 23581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 463) took 1490 ms. Trace:
I20260807 13:39:02.957307 24805 raft_consensus.cc:482] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:02.912225 24931 leader_election.cc:288] T b078a19f38494b04ad11b14d98ec4bca P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:02.594331 25040 raft_consensus.cc:2781] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:39:03.002159 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:02.663906 25305 raft_consensus.cc:482] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:02.726100 25310 raft_consensus.cc:482] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:02.655215 23631 leader_election.cc:302] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:02.693542 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:02.996490 23430 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:33986 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 586)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 593)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 588)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 572)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 510)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 574)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 567)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 578)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 577)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 530)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 570)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 592)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 432)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 433)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 508)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 526)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 531)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 436)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 453)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 454)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 559)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 561)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 568)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 573)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 583)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 459)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 461)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 462)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 463)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 464)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 467)
I20260807 13:39:02.768747 23574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 433) took 1480 ms. Trace:
I20260807 13:39:02.992368 23571 rpcz_store.cc:276] 0807 13:39:01.464903 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.881453 (+1416550us) service_pool.cc:227] Handling call
0807 13:39:02.893117 (+ 11664us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:02.893373 (+ 256us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:02.893420 (+ 47us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:02.893474 (+ 54us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:02.893514 (+ 40us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:02.893580 (+ 66us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:02.893716 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:02.919629 23475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 408) took 2352 ms. Trace:
I20260807 13:39:02.965873 25333 raft_consensus.cc:2781] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:39:03.014175 23581 rpcz_store.cc:276] 0807 13:39:01.500994 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.956127 (+1455133us) service_pool.cc:227] Handling call
0807 13:39:02.991139 (+ 35012us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:02.991319 (+ 180us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:02.991341 (+ 22us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:02.991381 (+ 40us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:02.991423 (+ 42us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:02.991476 (+ 53us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:02.991591 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:03.001842 25316 raft_consensus.cc:482] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:03.017650 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:03.031627 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:03.020148 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:02.707463 23470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 430) took 2107 ms. Trace:
I20260807 13:39:03.017241 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b1542e790794928a76e4b29a1d7732b" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:02.717504 25186 consensus_queue.cc:1035] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.293s
W20260807 13:39:02.957659 23473 rpcz_store.cc:269] 0807 13:39:01.273251 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:01.835373 (+562122us) service_pool.cc:227] Handling call
0807 13:39:02.542771 (+707398us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:02.999801 23577 rpcz_store.cc:276] 0807 13:39:01.384676 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.527991 (+1143315us) service_pool.cc:227] Handling call
0807 13:39:02.528446 (+ 455us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:02.528688 (+ 242us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:39:02.575018 (+ 46330us) log.cc:842] Serialized 14 byte log entry
0807 13:39:02.905635 (+330617us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:02.905865 (+ 230us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:02.905929 (+ 64us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:02.906011 (+ 82us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:02.906171 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":29738,"prepare.queue_time_us":45990,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":32625,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":295739,"threads_started":2,"wal-append.queue_time_us":376647}
I20260807 13:39:03.020582 24805 raft_consensus.cc:504] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:02.958026 23573 rpcz_store.cc:276] 0807 13:39:01.383066 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.312622 (+929556us) service_pool.cc:227] Handling call
0807 13:39:02.418096 (+105474us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:02.455108 (+ 37012us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:02.501491 (+ 46383us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:02.965531 25299 raft_consensus.cc:504] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:03.045385 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:39:03.252970 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 296616us
I20260807 13:39:03.255105 23481 raft_consensus.cc:2454] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
W20260807 13:39:03.130759 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 128385us
W20260807 13:39:03.200793 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 133940us
I20260807 13:39:03.259373 23633 leader_election.cc:302] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:39:03.152278 25165 leader_election.cc:288] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:03.261539 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:03.262539 23684 raft_consensus.cc:2396] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:39:03.263023 23571 raft_consensus.cc:1261] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:39:03.177443 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:03.045830 23478 raft_consensus.cc:2396] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 3 because replica has last-logged OpId of term: 2 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:39:03.268402 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:39:03.201774 25246 log.cc:924] Time spent T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.162s user 0.000s sys 0.000s
W20260807 13:39:03.235307 25318 log.cc:924] Time spent T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.279s user 0.001s sys 0.000s
I20260807 13:39:03.279821 23469 raft_consensus.cc:2396] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260807 13:39:03.291312 23532 connection.cc:232] RPC call timeout handler was delayed by -1.083042724058032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
I20260807 13:39:03.294489 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:03.276690 23479 raft_consensus.cc:3037] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:03.295024 23572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 466) took 1762 ms. Trace:
W20260807 13:39:03.295140 23532 connection.cc:232] RPC call timeout handler was delayed by -1.0356360401492566s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
I20260807 13:39:03.030822 25324 raft_consensus.cc:482] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:03.015267 25306 raft_consensus.cc:482] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:03.018245 25291 raft_consensus.cc:482] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:03.046459 23472 raft_consensus.cc:2362] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4. Re-sending same reply.
I20260807 13:39:03.113055 23578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 446) took 1771 ms. Trace:
I20260807 13:39:03.317818 23578 rpcz_store.cc:276] 0807 13:39:01.341739 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:01.400943 (+ 59204us) service_pool.cc:227] Handling call
0807 13:39:01.419471 (+ 18528us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:01.449932 (+ 30461us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:01.450008 (+ 76us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:01.471057 (+ 21049us) log.cc:842] Serialized 26 byte log entry
0807 13:39:02.115595 (+644538us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:02.115857 (+ 262us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:02.115961 (+ 104us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:03.112766 (+996805us) raft_consensus.cc:1671] finished
0807 13:39:03.112795 (+ 29us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:03.112977 (+ 182us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":32723,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":607290,"threads_started":1,"wal-append.queue_time_us":898686}
I20260807 13:39:03.320173 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:03.042200 25031 raft_consensus.cc:482] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:03.296115 23572 rpcz_store.cc:276] 0807 13:39:01.532162 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.009367 (+1477205us) service_pool.cc:227] Handling call
0807 13:39:03.011514 (+ 2147us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:03.011791 (+ 277us) raft_consensus.cc:1520] Early marking committed up to index 3
0807 13:39:03.034800 (+ 23009us) log.cc:842] Serialized 14 byte log entry
0807 13:39:03.294667 (+259867us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:03.294726 (+ 59us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:39:03.294773 (+ 47us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:03.294834 (+ 61us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:03.294962 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22733,"prepare.queue_time_us":23662,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"thread_start_us":259560,"threads_started":1}
I20260807 13:39:03.122776 24931 raft_consensus.cc:2781] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:39:03.310395 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:03.328922 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cd369f3fbdf4b61a5fd1e85690c9ba4" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:03.255074 25287 leader_election.cc:288] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:03.314976 23478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 555) took 1409 ms. Trace:
I20260807 13:39:03.238863 25326 raft_consensus.cc:482] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:03.252982 25273 leader_election.cc:288] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:03.031894 25305 raft_consensus.cc:504] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:03.032155 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 377017us
I20260807 13:39:03.043273 25311 raft_consensus.cc:482] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:03.042215 25040 raft_consensus.cc:686] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
W20260807 13:39:03.296283 23532 leader_election.cc:334] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 1.537s (SENT)
I20260807 13:39:03.324808 23578 raft_consensus.cc:1226] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4. Ops: []
I20260807 13:39:03.343943 23532 leader_election.cc:302] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
W20260807 13:39:03.327909 25233 log.cc:924] Time spent T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.063s user 0.000s sys 0.000s
I20260807 13:39:03.035919 25333 raft_consensus.cc:482] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:03.265610 23575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 464) took 1739 ms. Trace:
I20260807 13:39:03.321696 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:03.122144 25331 raft_consensus.cc:482] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:03.295468 23577 raft_consensus.cc:2454] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4.
I20260807 13:39:03.331705 23478 rpcz_store.cc:276] 0807 13:39:01.905552 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.031230 (+1125678us) service_pool.cc:227] Handling call
0807 13:39:03.314680 (+283450us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:03.401494 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faff067df57c4de49e89824bbc248751" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:39:03.345217 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 48972.8us
I20260807 13:39:03.301762 25235 raft_consensus.cc:2781] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:39:03.405531 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:03.281555 25165 raft_consensus.cc:482] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:03.397933 23481 raft_consensus.cc:2396] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:39:03.301529 25302 raft_consensus.cc:482] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
W20260807 13:39:03.403190 23532 leader_election.cc:334] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 2.149s (SENT)
I20260807 13:39:03.406164 23478 raft_consensus.cc:2379] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 1: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:39:03.409765 23478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 510) took 2651 ms. Trace:
I20260807 13:39:03.410220 23478 rpcz_store.cc:276] 0807 13:39:00.758778 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.401194 (+2642416us) service_pool.cc:227] Handling call
0807 13:39:03.409683 (+ 8489us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:03.411329 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6ae70649fa43bba8052b66977418f5" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:03.414031 23478 raft_consensus.cc:2454] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:39:03.415278 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39707c5d97164544b9f5c03db41181c0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:03.416086 23478 raft_consensus.cc:3037] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:03.346095 23471 raft_consensus.cc:2379] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 1: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
W20260807 13:39:03.424072 23532 leader_election.cc:334] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 2.214s (SENT)
I20260807 13:39:03.425043 23532 leader_election.cc:302] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:03.330339 25291 raft_consensus.cc:504] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:03.328660 25324 raft_consensus.cc:504] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:03.400735 25333 raft_consensus.cc:3037] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:03.429278 25324 leader_election.cc:288] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:03.430210 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39707c5d97164544b9f5c03db41181c0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:03.417429 25331 raft_consensus.cc:504] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:39:03.350507 25311 raft_consensus.cc:504] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:03.432567 24805 leader_election.cc:288] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:03.330045 25306 raft_consensus.cc:504] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:03.401644 23575 rpcz_store.cc:276] 0807 13:39:01.526740 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.991193 (+1464453us) service_pool.cc:227] Handling call
0807 13:39:03.024814 (+ 33621us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:03.111606 (+ 86792us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:03.122796 (+ 11190us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:03.153034 (+ 30238us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:03.193647 (+ 40613us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:03.229568 (+ 35921us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:03.257197 (+ 27629us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:03.434166 25311 leader_election.cc:288] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:03.434499 25306 leader_election.cc:288] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:03.330534 25339 raft_consensus.cc:482] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:03.400688 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:39:03.435568 25337 log.cc:924] Time spent T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Append to log took a long time: real 0.181s user 0.003s sys 0.000s
I20260807 13:39:03.436210 23573 raft_consensus.cc:2396] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260807 13:39:03.422523 25165 raft_consensus.cc:504] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:03.427186 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:03.438730 23480 raft_consensus.cc:2396] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:39:03.435454 25339 raft_consensus.cc:504] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:03.449787 23479 raft_consensus.cc:2454] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:39:03.450925 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:03.431346 23471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 567) took 1206 ms. Trace:
I20260807 13:39:03.452096 23479 raft_consensus.cc:2379] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 5: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:39:03.401295 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:03.423249 25302 raft_consensus.cc:504] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:03.468859 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 455) took 2085 ms. Trace:
I20260807 13:39:03.501091 23479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 578) took 1138 ms. Trace:
I20260807 13:39:03.035990 23475 rpcz_store.cc:276] 0807 13:39:00.556892 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:00.562221 (+ 5329us) service_pool.cc:227] Handling call
0807 13:39:00.604660 (+ 42439us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:00.604920 (+ 260us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:39:00.605313 (+ 393us) log.cc:842] Serialized 14 byte log entry
0807 13:39:01.958053 (+1352740us) log.cc:842] Serialized 14 byte log entry
0807 13:39:02.880884 (+922831us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:02.886483 (+ 5599us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:02.888952 (+ 2469us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:02.891171 (+ 2219us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:02.908921 (+ 17750us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":58862,"prepare.queue_time_us":57095,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":71,"raft.queue_time_us":604772,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":40154,"thread_start_us":2150500,"threads_started":4,"wal-append.queue_time_us":814583,"wal-append.run_cpu_time_us":1527,"wal-append.run_wall_time_us":1022485}
I20260807 13:39:03.429309 25291 leader_election.cc:288] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:39:03.446985 23532 leader_election.cc:334] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 2.415s (SENT)
I20260807 13:39:03.276225 23470 rpcz_store.cc:276] 0807 13:39:00.596587 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:00.725832 (+129245us) service_pool.cc:227] Handling call
0807 13:39:00.726168 (+ 336us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:00.726554 (+ 386us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:39:01.388400 (+661846us) log.cc:842] Serialized 14 byte log entry
0807 13:39:02.581802 (+1193402us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:02.621362 (+ 39560us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:02.637156 (+ 15794us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:02.673469 (+ 36313us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:02.703726 (+ 30257us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":32830,"prepare.queue_time_us":42023,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":311399,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":122,"thread_start_us":1734033,"threads_started":3,"wal-append.queue_time_us":836332,"wal-append.run_cpu_time_us":1168,"wal-append.run_wall_time_us":1007679}
I20260807 13:39:03.432567 25331 leader_election.cc:288] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765), e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037)
I20260807 13:39:03.463433 25351 raft_consensus.cc:2726] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:39:03.448963 25345 raft_consensus.cc:2726] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:39:03.122622 25316 raft_consensus.cc:504] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:03.440865 25235 raft_consensus.cc:686] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:03.339425 25326 raft_consensus.cc:504] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:03.024264 23574 rpcz_store.cc:276] 0807 13:39:01.288734 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:01.302366 (+ 13632us) service_pool.cc:227] Handling call
0807 13:39:01.438582 (+136216us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ffbce 000000000034aea9 00007fc69cf2ba30 00007fc69cff17b4 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:39:01.438789 (+ 207us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:39:01.439227 (+ 438us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:01.439269 (+ 42us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:39:01.459287 (+ 20018us) log.cc:842] Serialized 52 byte log entry
0807 13:39:02.166388 (+707101us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:02.611178 (+444790us) log.cc:842] Serialized 14 byte log entry
0807 13:39:02.711366 (+100188us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:02.720908 (+ 9542us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:02.726975 (+ 6067us) raft_consensus.cc:1671] finished
0807 13:39:02.751343 (+ 24368us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:02.768660 (+ 17317us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":39940,"prepare.queue_time_us":249357,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":90872,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":2341,"spinlock_wait_cycles":5764864,"thread_start_us":1045455,"threads_started":2,"wal-append.queue_time_us":843717}
I20260807 13:39:03.535772 23473 raft_consensus.cc:2454] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:39:03.546955 25326 leader_election.cc:288] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:03.334410 25031 raft_consensus.cc:504] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:03.547485 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:03.548380 23473 raft_consensus.cc:2454] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 6.
I20260807 13:39:03.461068 25320 raft_consensus.cc:482] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:03.549397 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:03.550282 23473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 530) took 2431 ms. Trace:
I20260807 13:39:03.549899 25320 raft_consensus.cc:504] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:03.550709 23473 rpcz_store.cc:276] 0807 13:39:01.118589 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.549100 (+2430511us) service_pool.cc:227] Handling call
0807 13:39:03.550172 (+ 1072us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:03.030427 25310 raft_consensus.cc:504] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:03.502125 23479 rpcz_store.cc:276] 0807 13:39:02.362928 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.450620 (+1087692us) service_pool.cc:227] Handling call
0807 13:39:03.501018 (+ 50398us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:03.556985 23469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 566) took 1341 ms. Trace:
W20260807 13:39:03.556654 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 221609us
I20260807 13:39:03.445324 25324 raft_consensus.cc:482] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:03.560451 23633 leader_election.cc:302] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:39:03.465734 25165 leader_election.cc:288] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:03.529989 23532 leader_election.cc:302] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
W20260807 13:39:03.536399 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 276342us
I20260807 13:39:03.349663 25273 raft_consensus.cc:482] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:03.469107 25276 leader_election.cc:288] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:03.541220 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a3da79d3b0447cbc19c4f28279e134" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:03.571569 23475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 577) took 1263 ms. Trace:
I20260807 13:39:03.572001 23475 rpcz_store.cc:276] 0807 13:39:02.307721 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.502771 (+1195050us) service_pool.cc:227] Handling call
0807 13:39:03.571488 (+ 68717us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:03.464620 23472 raft_consensus.cc:2396] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260807 13:39:03.534029 25329 log.cc:924] Time spent T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.263s user 0.000s sys 0.001s
I20260807 13:39:03.553408 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220c24fa0c52459182e1e89c74331f3b" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:03.576335 23473 raft_consensus.cc:2396] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
W20260807 13:39:03.576759 23430 connection.cc:232] RPC call timeout handler was delayed by -1.281472000060603s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
I20260807 13:39:03.557487 23469 rpcz_store.cc:276] 0807 13:39:02.215211 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.593963 (+378752us) service_pool.cc:227] Handling call
0807 13:39:03.542070 (+948107us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b540009d8d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:39:03.556911 (+ 14841us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":758484864}
W20260807 13:39:03.577289 23430 connection.cc:232] RPC call timeout handler was delayed by -1.212171999970451s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260807 13:39:03.577716 23430 connection.cc:232] RPC call timeout handler was delayed by -1.1599720001686364s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
W20260807 13:39:03.578064 23430 connection.cc:232] RPC call timeout handler was delayed by -1.136572000104934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
I20260807 13:39:03.455063 23471 rpcz_store.cc:276] 0807 13:39:02.225203 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.429845 (+1204642us) service_pool.cc:227] Handling call
0807 13:39:03.431261 (+ 1416us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:03.561578 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 556) took 1540 ms. Trace:
I20260807 13:39:03.580422 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:03.580277 23481 rpcz_store.cc:276] 0807 13:39:02.021494 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.256543 (+1235049us) service_pool.cc:227] Handling call
0807 13:39:03.561355 (+304812us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b5400084b54. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:39:03.561515 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":293332736}
I20260807 13:39:03.582445 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 435) took 2919 ms. Trace:
I20260807 13:39:03.585752 23473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 570) took 1340 ms. Trace:
I20260807 13:39:03.586249 23473 rpcz_store.cc:276] 0807 13:39:02.245605 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.553072 (+1307467us) service_pool.cc:227] Handling call
0807 13:39:03.585660 (+ 32588us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:03.590025 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:03.590620 23473 raft_consensus.cc:1261] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260807 13:39:03.591239 23473 pending_rounds.cc:76] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613: Aborting all ops after (but not including) 2
I20260807 13:39:03.592993 23475 raft_consensus.cc:1261] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:39:03.593817 23475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 433) took 2996 ms. Trace:
I20260807 13:39:03.594228 23475 rpcz_store.cc:276] 0807 13:39:00.597497 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.572803 (+2975306us) service_pool.cc:227] Handling call
0807 13:39:03.592561 (+ 19758us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:03.593476 (+ 915us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:03.593750 (+ 274us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:03.582892 23481 rpcz_store.cc:276] 0807 13:39:00.662644 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.581439 (+2918795us) service_pool.cc:227] Handling call
0807 13:39:03.581823 (+ 384us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:03.582030 (+ 207us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:03.582065 (+ 35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:03.582121 (+ 56us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:03.582162 (+ 41us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:03.582229 (+ 67us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:03.582363 (+ 134us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:03.508447 23580 rpcz_store.cc:276] 0807 13:39:01.383354 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.454732 (+1071378us) service_pool.cc:227] Handling call
0807 13:39:02.479226 (+ 24494us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:02.522631 (+ 43405us) raft_consensus.cc:1520] Early marking committed up to index 1
0807 13:39:02.522682 (+ 51us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:02.543451 (+ 20769us) log.cc:842] Serialized 26 byte log entry
0807 13:39:02.889482 (+346031us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:02.889563 (+ 81us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:02.889703 (+ 140us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:03.453222 (+563519us) raft_consensus.cc:1671] finished
0807 13:39:03.468596 (+ 15374us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:03.468784 (+ 188us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":23340,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":15477,"thread_start_us":295508,"threads_started":1,"wal-append.queue_time_us":397878}
I20260807 13:39:03.563844 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:03.591544 23473 pending_rounds.cc:97] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613: Aborting uncommitted NO_OP operation due to leader change: 4.3
W20260807 13:39:03.569702 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 122885us
I20260807 13:39:03.569036 25345 raft_consensus.cc:2726] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:39:03.448943 25040 consensus_queue.cc:237] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:03.578423 23430 connection.cc:232] RPC call timeout handler was delayed by -1.0708719999529421s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17470000000000002s for a response
I20260807 13:39:03.599611 23479 raft_consensus.cc:2396] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:39:03.600847 23430 leader_election.cc:302] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:03.599493 23473 raft_consensus.cc:2866] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260807 13:39:03.600026 23532 leader_election.cc:334] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 2.746s (SENT)
I20260807 13:39:03.601119 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:03.602229 23473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 508) took 2850 ms. Trace:
I20260807 13:39:03.602185 23532 leader_election.cc:302] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:03.602885 23478 raft_consensus.cc:2454] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:39:03.602751 23473 rpcz_store.cc:276] 0807 13:39:00.751832 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.587121 (+2835289us) service_pool.cc:227] Handling call
0807 13:39:03.587542 (+ 421us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:03.601994 (+ 14452us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:03.602171 (+ 177us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:03.575322 25311 raft_consensus.cc:482] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:03.575156 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:03.564832 25324 raft_consensus.cc:504] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:03.575461 25273 raft_consensus.cc:504] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:03.605130 23473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 438) took 2460 ms. Trace:
I20260807 13:39:03.744128 23478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 574) took 1497 ms. Trace:
I20260807 13:39:03.744699 23478 rpcz_store.cc:276] 0807 13:39:02.247077 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.414947 (+1167870us) service_pool.cc:227] Handling call
0807 13:39:03.744042 (+329095us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:03.746081 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b078a19f38494b04ad11b14d98ec4bca" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:03.746762 23674 raft_consensus.cc:1261] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:39:03.605645 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:39:03.635177 23532 leader_election.cc:334] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 2.912s (SENT)
I20260807 13:39:03.748059 23532 leader_election.cc:302] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:03.625419 23475 raft_consensus.cc:1226] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4. Ops: []
I20260807 13:39:03.689976 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:03.728600 23582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 465) took 2198 ms. Trace:
I20260807 13:39:03.743554 23473 rpcz_store.cc:276] 0807 13:39:01.144964 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.604332 (+2459368us) service_pool.cc:227] Handling call
0807 13:39:03.604660 (+ 328us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:03.604835 (+ 175us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:03.604862 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:03.604899 (+ 37us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:03.604930 (+ 31us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:03.604979 (+ 49us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:03.605080 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:03.584507 25340 raft_consensus.cc:482] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:03.579600 25306 raft_consensus.cc:482] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:03.575812 25165 raft_consensus.cc:482] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:03.624819 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220c24fa0c52459182e1e89c74331f3b" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:03.595609 23472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 572) took 1345 ms. Trace:
I20260807 13:39:03.746835 23478 raft_consensus.cc:3037] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:39:03.697304 25346 log.cc:924] Time spent T 39707c5d97164544b9f5c03db41181c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.121s user 0.001s sys 0.000s
W20260807 13:39:03.698431 25342 log.cc:924] Time spent T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.133s user 0.000s sys 0.001s
I20260807 13:39:03.755834 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:39:03.697891 25328 log.cc:924] Time spent T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.141s user 0.001s sys 0.000s
I20260807 13:39:03.600786 24732 raft_consensus.cc:2781] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:39:03.763124 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:03.596095 25352 raft_consensus.cc:482] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:03.603785 25291 raft_consensus.cc:482] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:03.623236 25305 leader_election.cc:288] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:03.706579 25326 raft_consensus.cc:2726] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:03.605530 24931 raft_consensus.cc:686] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:03.674492 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:03.770849 23478 raft_consensus.cc:2454] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:39:03.622759 25338 raft_consensus.cc:482] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:03.622867 25025 raft_consensus.cc:2726] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:39:03.749500 23582 rpcz_store.cc:276] 0807 13:39:01.530606 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:02.995094 (+1464488us) service_pool.cc:227] Handling call
0807 13:39:02.995518 (+ 424us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:02.995802 (+ 284us) raft_consensus.cc:1520] Early marking committed up to index 3
0807 13:39:03.034628 (+ 38826us) log.cc:842] Serialized 14 byte log entry
0807 13:39:03.727686 (+693058us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b18002d2440. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc69dfd68b1 00007fc69dfe3661 00007fc697cee82c 00007fc6951199dc 00007fc69df50a39 00007fc6951368bb 00007fc695134cbf 00007fc695134155 00007fc69ba34167 00007fc698069807 00007fc698078f0f
0807 13:39:03.727902 (+ 216us) log.cc:842] Serialized 14 byte log entry
0807 13:39:03.728132 (+ 230us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:03.728197 (+ 65us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:39:03.728255 (+ 58us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:03.728350 (+ 95us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:03.728512 (+ 162us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":54637,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":6063,"raft.queue_time_us":18110,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":49283,"spinlock_wait_cycles":63310592,"thread_start_us":466152,"threads_started":2,"wal-append.queue_time_us":466150}
I20260807 13:39:03.725217 25339 leader_election.cc:288] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:03.700742 25310 leader_election.cc:288] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:03.703493 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "356c6b3e51454d418acaa9be70bb9689" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:03.783258 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:03.799340 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:03.791862 25291 raft_consensus.cc:504] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:03.789820 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:03.796054 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:39:03.803221 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 235160us
I20260807 13:39:03.755975 25302 leader_election.cc:288] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:03.607720 25299 leader_election.cc:288] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:39:03.792307 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 157178us
I20260807 13:39:03.788681 23475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 531) took 2658 ms. Trace:
W20260807 13:39:03.810259 23532 leader_election.cc:334] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 3.200s (SENT)
I20260807 13:39:03.810909 23532 leader_election.cc:302] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:03.788709 24805 raft_consensus.cc:482] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:03.789930 25345 raft_consensus.cc:2726] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:39:03.812248 23475 rpcz_store.cc:276] 0807 13:39:01.130359 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.595308 (+2464949us) service_pool.cc:227] Handling call
0807 13:39:03.622304 (+ 26996us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:03.788240 (+165936us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:03.788602 (+ 362us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:03.754464 23472 rpcz_store.cc:276] 0807 13:39:02.246334 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.400087 (+1153753us) service_pool.cc:227] Handling call
0807 13:39:03.591820 (+191733us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:03.751974 25311 raft_consensus.cc:504] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:03.831432 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:03.753533 25306 raft_consensus.cc:504] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:03.626166 25235 consensus_queue.cc:237] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:03.837328 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:03.840291 23674 raft_consensus.cc:2454] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 6.
I20260807 13:39:03.753358 25165 raft_consensus.cc:504] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:03.846700 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 44277us
I20260807 13:39:03.851995 23532 leader_election.cc:398] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: Vote denied by peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037) with higher term. Message: Invalid argument: T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 5. Current term is 6.
I20260807 13:39:03.851634 24931 consensus_queue.cc:237] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:03.853746 23532 leader_election.cc:302] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:03.811892 23470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 569) took 1572 ms. Trace:
I20260807 13:39:03.829650 25025 raft_consensus.cc:2726] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:39:03.753849 25340 raft_consensus.cc:504] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:03.859906 23533 leader_election.cc:302] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:39:03.860908 23532 leader_election.cc:302] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
W20260807 13:39:03.866559 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 264731us
I20260807 13:39:03.780915 25352 raft_consensus.cc:504] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:03.947356 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 86569.7us
I20260807 13:39:03.855085 25345 raft_consensus.cc:482] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:03.799156 25357 consensus_queue.cc:1035] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
W20260807 13:39:03.859817 25304 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s user 0.003s sys 0.014s
I20260807 13:39:03.948170 23532 leader_election.cc:302] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
W20260807 13:39:03.943418 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 72711.7us
I20260807 13:39:03.951828 23430 leader_election.cc:302] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:03.952066 25351 raft_consensus.cc:2781] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:39:03.952544 25351 raft_consensus.cc:482] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:03.952769 25165 leader_election.cc:288] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:03.953035 25351 raft_consensus.cc:3037] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:03.953688 25299 consensus_queue.cc:1035] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260807 13:39:03.954478 25369 log.cc:924] Time spent T e6c49d31823d4cf4adca30ebd1b7eb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.094s user 0.000s sys 0.000s
I20260807 13:39:03.956626 25324 leader_election.cc:288] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:03.958943 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faff067df57c4de49e89824bbc248751" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:03.959586 23532 leader_election.cc:302] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:03.836441 24805 raft_consensus.cc:504] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:03.963387 23430 leader_election.cc:302] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:03.965130 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:03.965289 25265 raft_consensus.cc:2781] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:39:03.865916 24948 raft_consensus.cc:2781] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:39:03.802629 25338 raft_consensus.cc:504] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:03.943176 25331 raft_consensus.cc:2781] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:39:03.979904 25331 raft_consensus.cc:482] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:03.980295 25331 raft_consensus.cc:3037] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:39:03.981585 25311 leader_election.cc:288] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:03.981798 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 432) took 3384 ms. Trace:
I20260807 13:39:03.982201 23480 rpcz_store.cc:276] 0807 13:39:00.597218 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.565578 (+2968360us) service_pool.cc:227] Handling call
0807 13:39:03.566039 (+ 461us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:03.566366 (+ 327us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:03.566393 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:03.566873 (+ 480us) log.cc:842] Serialized 26 byte log entry
0807 13:39:03.831681 (+264808us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:03.831726 (+ 45us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:03.831798 (+ 72us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:03.981595 (+149797us) raft_consensus.cc:1671] finished
0807 13:39:03.981614 (+ 19us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:03.981742 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9460,"raft.queue_time_us":944,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":4593,"thread_start_us":227347,"threads_started":1,"wal-append.queue_time_us":365872}
W20260807 13:39:03.983595 25333 consensus_meta.cc:287] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.555s user 0.009s sys 0.002s
I20260807 13:39:03.984138 25333 raft_consensus.cc:504] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:03.985399 23737 tablet_bootstrap.cc:492] T 46e552e0aa3f4433858116fa31ee8458 P 5e0ea5aa0c6d4846a5ccc9962342e17a: No bootstrap required, opened a new log
I20260807 13:39:03.985872 23737 ts_tablet_manager.cc:1397] T 46e552e0aa3f4433858116fa31ee8458 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent bootstrapping tablet: real 1.746s user 0.015s sys 0.026s
I20260807 13:39:03.988466 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:03.989732 23430 leader_election.cc:302] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:03.970634 23532 leader_election.cc:302] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:03.976370 25155 raft_consensus.cc:2726] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:03.976933 25306 leader_election.cc:288] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:03.979099 25338 leader_election.cc:288] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:03.991283 23430 leader_election.cc:302] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:04.005370 23430 leader_election.cc:302] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:03.858312 23470 rpcz_store.cc:276] 0807 13:39:02.239039 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.542143 (+1303104us) service_pool.cc:227] Handling call
0807 13:39:03.810812 (+268669us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:04.007318 23430 leader_election.cc:302] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:04.000649 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:03.986315 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 454) took 1932 ms. Trace:
W20260807 13:39:04.000242 23532 leader_election.cc:334] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 1.997s (SENT)
I20260807 13:39:04.017148 23581 raft_consensus.cc:2379] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 1: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:39:03.971885 25265 raft_consensus.cc:482] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:03.988693 24948 raft_consensus.cc:482] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:04.015259 23480 rpcz_store.cc:276] 0807 13:39:02.053476 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.983834 (+1930358us) service_pool.cc:227] Handling call
0807 13:39:03.985843 (+ 2009us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:03.986012 (+ 169us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:03.986037 (+ 25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:03.986072 (+ 35us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:39:03.986099 (+ 27us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:03.986149 (+ 50us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:03.986264 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:04.023974 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:04.027163 23671 raft_consensus.cc:2454] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
I20260807 13:39:04.000262 25311 raft_consensus.cc:2726] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:39:04.029645 23533 leader_election.cc:302] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:39:03.998982 25323 raft_consensus.cc:2726] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:39:04.033049 23430 leader_election.cc:302] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:03.985302 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:04.016621 25306 raft_consensus.cc:2726] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260807 13:39:04.033756 23532 leader_election.cc:334] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 2.215s (SENT)
I20260807 13:39:04.028321 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 456) took 1974 ms. Trace:
I20260807 13:39:04.015000 25301 raft_consensus.cc:2726] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:39:04.010428 25372 raft_consensus.cc:2726] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:04.050661 23480 rpcz_store.cc:276] 0807 13:39:02.054156 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:04.026419 (+1972263us) service_pool.cc:227] Handling call
0807 13:39:04.026795 (+ 376us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:04.028014 (+ 1219us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:04.028038 (+ 24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:04.028078 (+ 40us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:04.028103 (+ 25us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:04.028151 (+ 48us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:04.028262 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:04.051841 23532 leader_election.cc:302] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:04.027426 25265 raft_consensus.cc:3037] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:39:04.027616 24948 raft_consensus.cc:3037] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:04.027189 25273 leader_election.cc:288] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:04.050112 25338 raft_consensus.cc:2726] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 13:39:04.081666 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 48708.4us
I20260807 13:39:03.976442 25351 raft_consensus.cc:504] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.032097 25025 raft_consensus.cc:482] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:04.066702 25355 raft_consensus.cc:2726] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:39:04.051172 25165 raft_consensus.cc:2726] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:04.033360 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:03.963784 25345 raft_consensus.cc:504] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.090184 23430 leader_election.cc:302] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:04.050688 23472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 453) took 1982 ms. Trace:
I20260807 13:39:04.063676 25315 raft_consensus.cc:2781] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260807 13:39:04.096046 23532 leader_election.cc:334] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 2.371s (SENT)
I20260807 13:39:04.063491 25155 raft_consensus.cc:482] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:04.102937 23532 leader_election.cc:302] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:04.098122 23430 leader_election.cc:302] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
W20260807 13:39:04.102031 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 305485us
W20260807 13:39:04.106032 23532 leader_election.cc:334] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 3.062s (SENT)
I20260807 13:39:04.106647 23532 leader_election.cc:302] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:04.109938 23430 leader_election.cc:302] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:04.111534 23430 leader_election.cc:302] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
W20260807 13:39:04.112229 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 299257us
I20260807 13:39:04.090137 25378 raft_consensus.cc:2781] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:39:04.103008 25372 raft_consensus.cc:2741] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260807 13:39:04.102638 25315 raft_consensus.cc:482] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:04.104648 23675 raft_consensus.cc:2454] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:39:04.121001 23430 leader_election.cc:302] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
W20260807 13:39:04.108438 23631 consensus_peers.cc:487] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a -> Peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Couldn't send request to peer e11cad1eeaf5424c94e51241096f6613. Status: Remote error: Service unavailable: UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:33986 dropped due to backpressure. The service queue is full; it has 50 items.. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:39:04.108873 25301 raft_consensus.cc:2726] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:04.113564 25338 raft_consensus.cc:2726] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:04.114300 25378 raft_consensus.cc:482] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:04.114880 25323 raft_consensus.cc:2726] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:39:04.137923 23430 leader_election.cc:302] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:04.116312 25306 raft_consensus.cc:482] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:04.144995 25326 consensus_queue.cc:1035] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:39:04.120175 24732 raft_consensus.cc:686] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
W20260807 13:39:04.132103 25365 log.cc:924] Time spent T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.174s user 0.000s sys 0.001s
I20260807 13:39:04.120051 25311 raft_consensus.cc:2726] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:39:04.151466 25352 leader_election.cc:288] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:04.153863 25316 leader_election.cc:288] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:04.161397 23429 leader_election.cc:302] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:04.109369 25155 raft_consensus.cc:504] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:04.157145 25379 log.cc:924] Time spent T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.065s user 0.000s sys 0.000s
I20260807 13:39:04.156992 25320 leader_election.cc:288] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:04.099249 25025 raft_consensus.cc:504] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.199327 23473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 439) took 3038 ms. Trace:
I20260807 13:39:04.125479 23470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 455) took 2067 ms. Trace:
W20260807 13:39:04.158592 25383 log.cc:924] Time spent T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.083s user 0.001s sys 0.000s
I20260807 13:39:04.165918 23430 leader_election.cc:302] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:04.201438 23473 rpcz_store.cc:276] 0807 13:39:01.160626 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.749889 (+2589263us) service_pool.cc:227] Handling call
0807 13:39:03.751065 (+ 1176us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:03.752948 (+ 1883us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:03.752992 (+ 44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:03.754228 (+ 1236us) log.cc:842] Serialized 26 byte log entry
0807 13:39:03.986805 (+232577us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:39:03.986847 (+ 42us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:03.986931 (+ 84us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:04.199137 (+212206us) raft_consensus.cc:1671] finished
0807 13:39:04.199155 (+ 18us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:04.199277 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2060,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":7674,"thread_start_us":184648,"threads_started":1,"wal-append.queue_time_us":284756}
W20260807 13:39:04.209703 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 48432.9us
W20260807 13:39:04.211015 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 105029us
I20260807 13:39:04.211149 23473 raft_consensus.cc:1261] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260807 13:39:04.211786 23473 pending_rounds.cc:76] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613: Aborting all ops after (but not including) 2
I20260807 13:39:04.212075 23473 pending_rounds.cc:97] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260807 13:39:04.212406 23473 raft_consensus.cc:2866] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:39:04.131677 25315 raft_consensus.cc:3037] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:04.118351 25322 consensus_queue.cc:1035] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260807 13:39:04.140606 25372 raft_consensus.cc:2781] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:39:04.200824 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:04.158982 25301 raft_consensus.cc:2726] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:39:04.159922 25378 raft_consensus.cc:3037] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:39:04.216511 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 50723.4us
I20260807 13:39:04.196251 25338 raft_consensus.cc:2726] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:39:04.226801 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:04.227314 23473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 561) took 2074 ms. Trace:
I20260807 13:39:04.159564 25340 leader_election.cc:288] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
@ 0x7fc695326e90 testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
I20260807 13:39:04.226852 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cd369f3fbdf4b61a5fd1e85690c9ba4" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:04.228096 23480 raft_consensus.cc:1261] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260807 13:39:04.198637 25306 raft_consensus.cc:504] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.201157 25310 raft_consensus.cc:482] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:04.218181 25352 raft_consensus.cc:2781] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:39:04.238515 23671 raft_consensus.cc:3037] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:04.231200 23473 rpcz_store.cc:276] 0807 13:39:02.153110 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:04.210187 (+2057077us) service_pool.cc:227] Handling call
0807 13:39:04.210657 (+ 470us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:04.221462 (+ 10805us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:04.227175 (+ 5713us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:04.238628 23480 pending_rounds.cc:76] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613: Aborting all ops after (but not including) 2
I20260807 13:39:04.257614 23480 pending_rounds.cc:97] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260807 13:39:04.257828 23480 raft_consensus.cc:2866] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:39:04.257871 23473 raft_consensus.cc:1261] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260807 13:39:04.204593 25273 raft_consensus.cc:482] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:04.258487 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 559) took 2136 ms. Trace:
I20260807 13:39:04.263978 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:04.264251 23480 rpcz_store.cc:276] 0807 13:39:02.122524 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:04.061084 (+1938560us) service_pool.cc:227] Handling call
0807 13:39:04.227486 (+166402us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b5800003398. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:39:04.227726 (+ 240us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:04.258288 (+ 30562us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:04.258434 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":11295616}
I20260807 13:39:04.239068 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 436) took 3096 ms. Trace:
W20260807 13:39:04.252187 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 103545us
I20260807 13:39:04.260426 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:04.260805 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:04.260864 23430 leader_election.cc:302] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:04.265538 23481 rpcz_store.cc:276] 0807 13:39:01.142632 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.597960 (+2455328us) service_pool.cc:227] Handling call
0807 13:39:03.598410 (+ 450us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:03.598793 (+ 383us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:03.598833 (+ 40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:03.600587 (+ 1754us) log.cc:842] Serialized 26 byte log entry
0807 13:39:03.812461 (+211874us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:03.812500 (+ 39us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:03.812570 (+ 70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:04.238802 (+426232us) raft_consensus.cc:1671] finished
0807 13:39:04.238826 (+ 24us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:04.239001 (+ 175us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":94206,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":31914,"thread_start_us":159879,"threads_started":1,"wal-append.queue_time_us":413602}
I20260807 13:39:04.262605 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:04.099404 23472 rpcz_store.cc:276] 0807 13:39:02.053040 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.839700 (+1786660us) service_pool.cc:227] Handling call
0807 13:39:03.968243 (+128543us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:03.999262 (+ 31019us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:04.002824 (+ 3562us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:04.010163 (+ 7339us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:04.018413 (+ 8250us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:04.027991 (+ 9578us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:04.034796 (+ 6805us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:04.261267 23473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 568) took 2024 ms. Trace:
I20260807 13:39:04.271993 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:04.272104 23473 rpcz_store.cc:276] 0807 13:39:02.236467 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:04.257224 (+2020757us) service_pool.cc:227] Handling call
0807 13:39:04.257544 (+ 320us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:04.258208 (+ 664us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:04.261206 (+ 2998us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:04.274328 23578 raft_consensus.cc:1226] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 4. Current term is 5. Ops: []
I20260807 13:39:04.275492 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b078a19f38494b04ad11b14d98ec4bca" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:04.242182 25025 leader_election.cc:288] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:04.267904 25372 raft_consensus.cc:686] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 6 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:39:04.277411 25372 consensus_queue.cc:237] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.280589 25338 consensus_queue.cc:1046] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:04.282416 25291 leader_election.cc:288] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:04.282992 25291 raft_consensus.cc:2726] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:39:04.283224 23430 leader_election.cc:302] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:04.284438 23430 leader_election.cc:302] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:04.276216 23575 raft_consensus.cc:3037] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:04.285727 23430 leader_election.cc:302] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:04.267697 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 583) took 1765 ms. Trace:
I20260807 13:39:04.287163 23481 rpcz_store.cc:276] 0807 13:39:02.502045 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:04.267002 (+1764957us) service_pool.cc:227] Handling call
0807 13:39:04.267263 (+ 261us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:04.267436 (+ 173us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:04.267452 (+ 16us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:04.267485 (+ 33us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:04.267504 (+ 19us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:04.267536 (+ 32us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:04.267605 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:04.291031 23575 raft_consensus.cc:2454] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 1.
I20260807 13:39:04.292877 23737 raft_consensus.cc:348] T 46e552e0aa3f4433858116fa31ee8458 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.293695 23737 raft_consensus.cc:374] T 46e552e0aa3f4433858116fa31ee8458 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:04.293984 23737 raft_consensus.cc:729] T 46e552e0aa3f4433858116fa31ee8458 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Initialized, Role: FOLLOWER
I20260807 13:39:04.215456 24805 leader_election.cc:288] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:39:04.238300 25387 log.cc:924] Time spent T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.122s user 0.000s sys 0.000s
I20260807 13:39:04.298239 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:04.229763 25333 leader_election.cc:288] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:04.311221 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:04.298885 25339 raft_consensus.cc:2726] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:39:04.311440 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:04.315284 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 461) took 1436 ms. Trace:
I20260807 13:39:04.240996 25155 leader_election.cc:288] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:04.247550 25306 leader_election.cc:288] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:04.231964 25351 leader_election.cc:288] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:04.238973 25311 raft_consensus.cc:2726] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:39:04.254904 25352 raft_consensus.cc:482] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:04.297166 25291 raft_consensus.cc:2781] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:39:04.247988 25310 raft_consensus.cc:504] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.320050 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220c24fa0c52459182e1e89c74331f3b" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:04.332365 23480 raft_consensus.cc:1261] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260807 13:39:04.332907 23578 raft_consensus.cc:2454] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:39:04.320394 25031 leader_election.cc:288] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:04.313325 23737 consensus_queue.cc:260] T 46e552e0aa3f4433858116fa31ee8458 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.237000 25345 leader_election.cc:288] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:04.325246 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:04.363154 23572 raft_consensus.cc:2396] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260807 13:39:04.364142 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:04.320129 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:04.308801 25323 raft_consensus.cc:2726] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:39:04.367938 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:04.359920 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:04.329612 25352 raft_consensus.cc:3037] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:04.365625 23577 raft_consensus.cc:2454] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:39:04.321058 23481 rpcz_store.cc:276] 0807 13:39:02.879000 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:04.288060 (+1409060us) service_pool.cc:227] Handling call
0807 13:39:04.314639 (+ 26579us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:04.314860 (+ 221us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:04.314907 (+ 47us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:04.314961 (+ 54us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:04.315003 (+ 42us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:04.315072 (+ 69us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:04.315208 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:04.236012 24732 consensus_queue.cc:237] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:04.369987 23532 leader_election.cc:334] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 3.215s (SENT)
I20260807 13:39:04.329957 25291 raft_consensus.cc:482] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:04.323571 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "356c6b3e51454d418acaa9be70bb9689" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:04.381268 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:04.373567 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faff067df57c4de49e89824bbc248751" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:04.205405 23470 rpcz_store.cc:276] 0807 13:39:02.053830 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:04.019604 (+1965774us) service_pool.cc:227] Handling call
0807 13:39:04.080573 (+ 60969us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:04.095044 (+ 14471us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:04.098323 (+ 3279us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:04.101145 (+ 2822us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:04.107024 (+ 5879us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:04.113099 (+ 6075us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:04.121023 (+ 7924us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:04.375427 23532 leader_election.cc:302] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:04.362850 25311 raft_consensus.cc:482] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:04.331507 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:04.374557 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:04.286901 25273 raft_consensus.cc:504] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.397114 23577 raft_consensus.cc:2454] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:39:04.325891 25331 raft_consensus.cc:504] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.396984 23572 raft_consensus.cc:2454] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4.
I20260807 13:39:04.406913 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:04.408385 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:04.409049 23572 raft_consensus.cc:2454] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:39:04.409866 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:04.419277 23473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 459) took 1541 ms. Trace:
I20260807 13:39:04.419725 23473 rpcz_store.cc:276] 0807 13:39:02.878280 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:04.272953 (+1394673us) service_pool.cc:227] Handling call
0807 13:39:04.273234 (+ 281us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:04.273433 (+ 199us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:39:04.281851 (+ 8418us) log.cc:842] Serialized 14 byte log entry
0807 13:39:04.419019 (+137168us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:04.419061 (+ 42us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:04.419089 (+ 28us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:04.419138 (+ 49us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:04.419226 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":8279,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"spinlock_wait_cycles":63872,"thread_start_us":136663,"threads_started":1}
I20260807 13:39:04.421181 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:04.422179 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:04.380414 25291 raft_consensus.cc:3037] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:04.423501 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:04.423609 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:04.424407 23481 raft_consensus.cc:2454] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
I20260807 13:39:04.425004 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:04.396073 25402 raft_consensus.cc:482] T 46e552e0aa3f4433858116fa31ee8458 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:04.429678 23737 ts_tablet_manager.cc:1428] T 46e552e0aa3f4433858116fa31ee8458 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent starting tablet: real 0.444s user 0.006s sys 0.002s
I20260807 13:39:04.432331 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:04.432246 23430 leader_election.cc:302] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:04.431833 25040 raft_consensus.cc:482] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:04.434357 25040 raft_consensus.cc:504] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.436092 23479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 437) took 3292 ms. Trace:
I20260807 13:39:04.436597 25040 leader_election.cc:288] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:04.363863 25265 raft_consensus.cc:504] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.436517 23479 rpcz_store.cc:276] 0807 13:39:01.143765 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.601039 (+2457274us) service_pool.cc:227] Handling call
0807 13:39:03.631943 (+ 30904us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:03.838340 (+206397us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:03.838384 (+ 44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:03.848537 (+ 10153us) log.cc:842] Serialized 26 byte log entry
0807 13:39:04.201908 (+353371us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:04.201946 (+ 38us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:04.202020 (+ 74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:04.435863 (+233843us) raft_consensus.cc:1671] finished
0807 13:39:04.435883 (+ 20us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:04.436026 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":77831,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":1814,"thread_start_us":422580,"threads_started":2,"wal-append.queue_time_us":460398}
I20260807 13:39:04.438597 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:04.439245 25265 leader_election.cc:288] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 6 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:04.444608 25310 leader_election.cc:288] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:39:04.445993 23631 consensus_peers.cc:487] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a -> Peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Couldn't send request to peer e11cad1eeaf5424c94e51241096f6613. Status: Remote error: Service unavailable: UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:33986 dropped due to backpressure. The service queue is full; it has 50 items.. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:39:04.446923 25273 leader_election.cc:288] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:04.450150 25378 raft_consensus.cc:504] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.431164 23472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 462) took 1551 ms. Trace:
I20260807 13:39:04.457077 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:04.439255 23479 raft_consensus.cc:2454] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
I20260807 13:39:04.459285 25323 raft_consensus.cc:482] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:04.428478 25417 raft_consensus.cc:2726] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:39:04.459760 23471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 526) took 3434 ms. Trace:
I20260807 13:39:04.459818 25306 raft_consensus.cc:482] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:04.464037 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:39:04.465726 23407 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:39:04.468590 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:04.469785 23430 leader_election.cc:302] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
W20260807 13:39:04.485205 25408 log.cc:924] Time spent T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.151s user 0.000s sys 0.009s
I20260807 13:39:04.478837 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:04.485939 23430 leader_election.cc:302] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:04.413285 25311 raft_consensus.cc:504] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.487223 23430 leader_election.cc:302] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:04.486958 25323 raft_consensus.cc:504] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.478735 25165 raft_consensus.cc:2726] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 13:39:04.489859 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 86784.5us
I20260807 13:39:04.461087 25402 raft_consensus.cc:504] T 46e552e0aa3f4433858116fa31ee8458 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:04.471315 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 331265us
I20260807 13:39:04.494961 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:04.502283 23532 leader_election.cc:302] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:04.503551 23532 leader_election.cc:302] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:04.495415 23430 leader_election.cc:302] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:04.505007 23532 leader_election.cc:302] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:04.506165 23430 leader_election.cc:302] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:04.512079 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:04.513761 23631 leader_election.cc:302] T b078a19f38494b04ad11b14d98ec4bca P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:04.515928 23430 leader_election.cc:302] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:04.492146 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:04.483191 23471 rpcz_store.cc:276] 0807 13:39:01.025526 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.596143 (+2570617us) service_pool.cc:227] Handling call
0807 13:39:03.636114 (+ 39971us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:04.003513 (+367399us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:04.015916 (+ 12403us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:04.018813 (+ 2897us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:39:04.021388 (+ 2575us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:04.459338 (+437950us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54000b90d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:39:04.459419 (+ 81us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:04.459629 (+ 210us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":806769920}
I20260807 13:39:04.506090 25357 raft_consensus.cc:2781] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:39:04.511529 25165 raft_consensus.cc:2781] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:39:04.493716 25299 raft_consensus.cc:2726] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:39:04.500756 25310 raft_consensus.cc:2726] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:39:04.508208 25345 raft_consensus.cc:2781] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:39:04.473796 23472 rpcz_store.cc:276] 0807 13:39:02.879312 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:04.312941 (+1433629us) service_pool.cc:227] Handling call
0807 13:39:04.358507 (+ 45566us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:04.374321 (+ 15814us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:04.376425 (+ 2104us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:04.399356 (+ 22931us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:04.403520 (+ 4164us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:04.419488 (+ 15968us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:04.425507 (+ 6019us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:04.519707 23430 leader_election.cc:302] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:04.509755 25339 raft_consensus.cc:2726] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:39:04.571942 23671 raft_consensus.cc:2454] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:39:04.561156 23532 leader_election.cc:302] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:04.494235 25306 raft_consensus.cc:504] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:04.576378 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 56793us
I20260807 13:39:04.516033 25355 raft_consensus.cc:2726] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:39:04.577880 23430 leader_election.cc:302] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:04.579089 24948 raft_consensus.cc:504] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.562664 25165 raft_consensus.cc:482] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:04.579701 25315 raft_consensus.cc:504] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.584658 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:04.585644 25311 leader_election.cc:288] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:04.566021 25265 raft_consensus.cc:2726] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:39:04.587153 25393 log.cc:924] Time spent T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.313s user 0.001s sys 0.000s
I20260807 13:39:04.520138 25403 raft_consensus.cc:2781] T b078a19f38494b04ad11b14d98ec4bca P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:39:04.591696 23430 leader_election.cc:302] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:04.527951 25357 raft_consensus.cc:482] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:04.517855 25322 consensus_queue.cc:1035] T 8b6d649ae21a41c9b6723944d7036688 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260807 13:39:04.597975 23533 leader_election.cc:302] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:39:04.519126 25031 consensus_queue.cc:1035] T ae09b72e43be4ee7a4c56900f3f31fdb P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.071s
I20260807 13:39:04.599922 23430 leader_election.cc:302] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:04.519295 25409 consensus_queue.cc:1035] T f846254307f64297ae642172f37ab394 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
I20260807 13:39:04.600461 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:04.602694 23471 raft_consensus.cc:2454] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:39:04.603840 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:04.560768 25316 consensus_queue.cc:1035] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260807 13:39:04.605274 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cd369f3fbdf4b61a5fd1e85690c9ba4" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:04.595288 25331 leader_election.cc:288] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 7 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:04.605948 23471 raft_consensus.cc:2454] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 0.
I20260807 13:39:04.607837 25377 raft_consensus.cc:2726] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:04.608779 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:04.609213 25403 raft_consensus.cc:686] T b078a19f38494b04ad11b14d98ec4bca P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:04.609509 23472 raft_consensus.cc:2454] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:39:04.610270 23430 leader_election.cc:302] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:04.610474 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:04.610175 25403 consensus_queue.cc:237] T b078a19f38494b04ad11b14d98ec4bca P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.595995 25165 raft_consensus.cc:3037] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:04.612059 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cd369f3fbdf4b61a5fd1e85690c9ba4" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:04.612319 25326 raft_consensus.cc:2726] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:39:04.611692 25310 raft_consensus.cc:2726] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:04.612890 23471 raft_consensus.cc:3037] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:04.614503 23469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 434) took 4016 ms. Trace:
I20260807 13:39:04.614889 23469 rpcz_store.cc:276] 0807 13:39:00.597823 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.577696 (+2979873us) service_pool.cc:227] Handling call
0807 13:39:03.578142 (+ 446us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:03.770797 (+192655us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:03.770844 (+ 47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:03.795806 (+ 24962us) log.cc:842] Serialized 26 byte log entry
0807 13:39:04.036104 (+240298us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:04.036162 (+ 58us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:04.036255 (+ 93us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:04.614294 (+578039us) raft_consensus.cc:1671] finished
0807 13:39:04.614315 (+ 21us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:04.614454 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9486,"raft.queue_time_us":95464,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":4768,"thread_start_us":385365,"threads_started":2,"wal-append.queue_time_us":301879}
I20260807 13:39:04.590266 25299 raft_consensus.cc:2726] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:04.562275 25351 consensus_queue.cc:1035] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 0, Time since last communication: 0.034s
I20260807 13:39:04.621078 23580 raft_consensus.cc:1226] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 13:39:04.567718 25345 raft_consensus.cc:482] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:04.626912 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:04.595619 25339 raft_consensus.cc:2781] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:39:04.627676 23671 raft_consensus.cc:3037] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:39:04.628525 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faff067df57c4de49e89824bbc248751" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:04.616284 25311 raft_consensus.cc:2781] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:39:04.632059 25311 raft_consensus.cc:482] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:04.600832 25357 raft_consensus.cc:3037] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:04.632437 25311 raft_consensus.cc:3037] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:04.654436 23671 raft_consensus.cc:2454] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 7.
I20260807 13:39:04.623750 25155 raft_consensus.cc:2726] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:04.623366 25025 raft_consensus.cc:482] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
W20260807 13:39:04.655130 25360 log.cc:924] Time spent T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.800s user 0.001s sys 0.011s
I20260807 13:39:04.624441 25409 raft_consensus.cc:2781] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:39:04.661052 25409 raft_consensus.cc:686] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:39:04.661017 25025 raft_consensus.cc:504] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.616039 25301 raft_consensus.cc:482] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
W20260807 13:39:04.660159 25421 log.cc:924] Time spent T 98b1cb53677841e393a54d9204f8959e P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.178s user 0.001s sys 0.000s
I20260807 13:39:04.665061 23533 leader_election.cc:302] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:39:04.665788 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "608f7e63bc4648e0890e5f601c52736c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:04.662236 25409 consensus_queue.cc:237] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.666189 23430 leader_election.cc:302] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:04.667532 23430 leader_election.cc:302] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:04.668371 25377 raft_consensus.cc:2726] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:04.668933 23532 leader_election.cc:302] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:04.669201 25377 raft_consensus.cc:2726] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:04.670097 25323 leader_election.cc:288] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:04.670198 25287 raft_consensus.cc:3032] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:39:04.671979 25287 raft_consensus.cc:729] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:39:04.672904 25287 consensus_queue.cc:260] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.673988 25287 raft_consensus.cc:3037] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:04.673810 25291 raft_consensus.cc:504] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.674191 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:04.675068 23473 raft_consensus.cc:2379] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 5: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:39:04.669348 25265 raft_consensus.cc:2781] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:39:04.677208 25265 raft_consensus.cc:686] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 7 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:39:04.630134 25339 raft_consensus.cc:482] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:04.677801 25339 raft_consensus.cc:3037] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:04.678205 25265 consensus_queue.cc:237] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.681265 25025 leader_election.cc:288] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:04.681527 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 573) took 2434 ms. Trace:
I20260807 13:39:04.682081 23480 rpcz_store.cc:276] 0807 13:39:02.246724 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:04.265069 (+2018345us) service_pool.cc:227] Handling call
0807 13:39:04.265322 (+ 253us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:04.332949 (+ 67627us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:04.681151 (+348202us) spinlock_profiling.cc:243] Waited 66.5 ms on lock 0x7b5400273654. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:39:04.681441 (+ 290us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":152973568}
W20260807 13:39:04.671516 23581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 471) took 1401 ms (client timeout 1563 ms). Trace:
I20260807 13:39:04.684252 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:39:04.684722 23581 rpcz_store.cc:269] 0807 13:39:03.270191 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.270356 (+ 165us) service_pool.cc:227] Handling call
0807 13:39:04.671210 (+1400854us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b5400387a54. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:39:04.671419 (+ 209us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1567970688}
I20260807 13:39:04.662233 23680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 568) took 1350 ms. Trace:
I20260807 13:39:04.675091 23481 raft_consensus.cc:2362] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3. Re-sending same reply.
I20260807 13:39:04.686234 23680 rpcz_store.cc:276] 0807 13:39:03.311418 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.311611 (+ 193us) service_pool.cc:227] Handling call
0807 13:39:03.312094 (+ 483us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:39:03.319052 (+ 6958us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:03.319083 (+ 31us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:39:03.342952 (+ 23869us) log.cc:842] Serialized 52 byte log entry
0807 13:39:03.659631 (+316679us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:39:03.659702 (+ 71us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:03.659804 (+ 102us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:04.654819 (+995015us) spinlock_profiling.cc:243] Waited 6.49 ms on lock 0x7b24000c4a18. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc694f8fcf4 00007fc694f8ddfb 00007fc69501c559 00007fc69501c1e5 00007fc69501b82d 00007fc697cca46e 00007fc697ce1c0c 00007fc697ce0f36 00007fc697ce0b58 00007fc697cea551
0807 13:39:04.661899 (+ 7080us) raft_consensus.cc:1671] finished
0807 13:39:04.661924 (+ 25us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:04.662166 (+ 242us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6442,"raft.queue_time_us":6776,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":22600,"spinlock_wait_cycles":14916992,"thread_start_us":262422,"threads_started":1,"wal-append.queue_time_us":392038}
I20260807 13:39:04.689030 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:04.689653 23532 leader_election.cc:302] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:04.690863 23532 leader_election.cc:302] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:04.691155 23480 raft_consensus.cc:1261] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260807 13:39:04.692164 23532 leader_election.cc:302] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:04.692178 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 463) took 1812 ms. Trace:
I20260807 13:39:04.693651 23480 rpcz_store.cc:276] 0807 13:39:02.879611 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:04.683245 (+1803634us) service_pool.cc:227] Handling call
0807 13:39:04.690704 (+ 7459us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:04.691858 (+ 1154us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:04.692108 (+ 250us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:04.697683 23430 leader_election.cc:302] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:04.699380 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a3da79d3b0447cbc19c4f28279e134" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:04.700183 23578 raft_consensus.cc:2454] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:39:04.630415 25345 raft_consensus.cc:3037] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:39:04.700959 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:04.702613 23578 raft_consensus.cc:2454] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:39:04.628790 25351 consensus_queue.cc:1225] T 944b1327a944412b8ef8b5a60f96fb2d P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer e11cad1eeaf5424c94e51241096f6613 log is divergent from this leader: its last log entry 5.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260807 13:39:04.704609 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:04.625249 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39707c5d97164544b9f5c03db41181c0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:04.708379 23532 leader_election.cc:302] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:04.650018 25378 leader_election.cc:288] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:39:04.706728 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 114214us
W20260807 13:39:04.758693 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 50396.7us
W20260807 13:39:04.759593 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 58441.1us
I20260807 13:39:04.768292 23430 leader_election.cc:302] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:04.770668 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:04.771517 23671 raft_consensus.cc:3037] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:04.770183 23532 leader_election.cc:302] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:04.772420 25316 raft_consensus.cc:2781] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:39:04.772782 25316 raft_consensus.cc:482] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:04.772877 23532 leader_election.cc:302] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:04.773190 25316 raft_consensus.cc:3037] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:04.774149 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:04.787962 23671 raft_consensus.cc:2454] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 5.
I20260807 13:39:04.649593 24948 leader_election.cc:288] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:04.792737 23430 leader_election.cc:302] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:04.788291 25311 raft_consensus.cc:504] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:04.817451 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 99055.7us
I20260807 13:39:04.705700 25273 raft_consensus.cc:2726] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:39:04.702792 24805 raft_consensus.cc:2781] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:39:04.705106 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:39:04.884500 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 91865.6us
I20260807 13:39:04.707167 25025 raft_consensus.cc:2781] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:39:04.791107 25315 leader_election.cc:288] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:04.662245 25301 raft_consensus.cc:504] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.793947 25333 raft_consensus.cc:2726] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:04.890461 23469 raft_consensus.cc:2354] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2.
I20260807 13:39:04.900247 25356 consensus_queue.cc:1035] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260807 13:39:04.901228 25411 log.cc:924] Time spent T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.318s user 0.001s sys 0.000s
I20260807 13:39:04.794195 25355 raft_consensus.cc:2726] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:04.892453 25323 raft_consensus.cc:2781] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260807 13:39:04.929692 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 148671us
I20260807 13:39:04.892697 25025 raft_consensus.cc:482] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:04.817234 23472 raft_consensus.cc:2362] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2. Re-sending same reply.
I20260807 13:39:04.867830 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:04.914135 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a3da79d3b0447cbc19c4f28279e134" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:04.869542 25338 raft_consensus.cc:2781] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:39:04.868311 24948 raft_consensus.cc:2726] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 13:39:04.909850 25435 log.cc:924] Time spent T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.282s user 0.000s sys 0.001s
I20260807 13:39:04.883713 24805 raft_consensus.cc:482] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:04.892027 25291 leader_election.cc:288] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:04.864581 25352 raft_consensus.cc:504] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.939139 25025 raft_consensus.cc:3037] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:04.950382 25311 leader_election.cc:288] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:04.931214 25306 leader_election.cc:288] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:04.930342 25323 raft_consensus.cc:482] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:04.952592 25323 raft_consensus.cc:3037] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:04.958959 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:04.959750 23480 raft_consensus.cc:2454] T b6646e8113874345a9835c8fce2e0c51 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:39:04.961592 25301 leader_election.cc:288] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:04.930915 23573 raft_consensus.cc:1226] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:39:04.963435 25165 raft_consensus.cc:504] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:04.964666 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e552e0aa3f4433858116fa31ee8458" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:04.965353 23672 raft_consensus.cc:3037] T 46e552e0aa3f4433858116fa31ee8458 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:04.965770 25165 leader_election.cc:288] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:04.967118 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:04.968611 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:04.972739 23672 raft_consensus.cc:2454] T 46e552e0aa3f4433858116fa31ee8458 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:39:04.973243 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:04.941083 25338 raft_consensus.cc:482] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:04.975579 23680 raft_consensus.cc:1226] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 13:39:04.976656 23415 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Sending DeleteTablet for 3 replicas of tablet fcdef01e85a44e1093dd335055986423
I20260807 13:39:04.977746 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b1542e790794928a76e4b29a1d7732b" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:04.978088 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:04.978511 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faff067df57c4de49e89824bbc248751" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
W20260807 13:39:04.980243 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 114469us
I20260807 13:39:04.982441 23479 raft_consensus.cc:2379] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 4: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
W20260807 13:39:04.983404 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 210613us
I20260807 13:39:04.984125 23681 raft_consensus.cc:1226] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 7 FOLLOWER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 6. Current term is 7. Ops: []
I20260807 13:39:04.984614 23532 leader_election.cc:302] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:04.984640 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b1542e790794928a76e4b29a1d7732b" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:04.942029 25402 leader_election.cc:288] T 46e552e0aa3f4433858116fa31ee8458 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:04.945817 24805 raft_consensus.cc:3037] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:04.985874 23532 leader_election.cc:302] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:04.986678 23572 raft_consensus.cc:2454] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:39:04.979445 25338 raft_consensus.cc:3037] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
@ 0x7fc695304a92 testing::Test::Run() at ??:0
I20260807 13:39:04.986452 25301 raft_consensus.cc:2726] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:39:04.993925 23429 leader_election.cc:302] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:04.996980 25287 raft_consensus.cc:2726] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:39:04.995256 23429 leader_election.cc:302] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:05.000044 25316 raft_consensus.cc:504] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.002002 25311 raft_consensus.cc:2781] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:39:05.002444 25316 leader_election.cc:288] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:05.002610 25311 raft_consensus.cc:686] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613 [term 1 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:39:04.999118 25357 raft_consensus.cc:504] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.003538 25311 consensus_queue.cc:237] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.006539 24805 raft_consensus.cc:504] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.008397 23532 leader_election.cc:302] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:05.015476 23429 leader_election.cc:302] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:05.009222 25025 raft_consensus.cc:504] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.010710 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e552e0aa3f4433858116fa31ee8458" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:05.016124 25302 raft_consensus.cc:2726] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:39:05.016458 23575 raft_consensus.cc:3037] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:39:05.013351 25306 consensus_queue.cc:1046] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:39:05.029773 25291 raft_consensus.cc:3032] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:39:05.030202 25291 raft_consensus.cc:729] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:39:05.030555 25352 leader_election.cc:288] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:05.013759 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:05.031219 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220c24fa0c52459182e1e89c74331f3b" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:05.031071 25291 consensus_queue.cc:260] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.014557 25165 consensus_queue.cc:1046] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:39:05.032436 25291 raft_consensus.cc:3037] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:05.032562 25165 raft_consensus.cc:3032] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:39:05.032953 25165 raft_consensus.cc:729] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:39:05.033874 25287 raft_consensus.cc:2726] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:39:05.033762 25165 consensus_queue.cc:260] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.034525 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:05.035044 25165 raft_consensus.cc:3037] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:39:05.035156 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "608f7e63bc4648e0890e5f601c52736c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:05.035362 23577 raft_consensus.cc:2454] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 5.
I20260807 13:39:05.035794 23480 raft_consensus.cc:3037] T 608f7e63bc4648e0890e5f601c52736c P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:05.036055 23475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 442) took 3872 ms. Trace:
I20260807 13:39:05.021818 23429 leader_election.cc:302] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:05.036445 23475 rpcz_store.cc:276] 0807 13:39:01.164000 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.830915 (+2666915us) service_pool.cc:227] Handling call
0807 13:39:03.847376 (+ 16461us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:03.847841 (+ 465us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:03.847877 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:03.858171 (+ 10294us) log.cc:842] Serialized 26 byte log entry
0807 13:39:04.226271 (+368100us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:04.226309 (+ 38us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:04.226377 (+ 68us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:04.685450 (+459073us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b44000232cc. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc695049a95 00007fc69504a4b2 00007fc697cf2511 00007fc697cede1a 00007fc697ce1bee 00007fc697ce0f36 00007fc697ce0b58 00007fc697cea551 00007fc697cea509 00007fc697cea499
0807 13:39:05.035716 (+350266us) raft_consensus.cc:1671] finished
0807 13:39:05.035736 (+ 20us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:05.035992 (+ 256us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2289,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":4726,"spinlock_wait_cycles":9478016,"thread_start_us":214075,"threads_started":1,"wal-append.queue_time_us":454501}
I20260807 13:39:05.064183 23575 raft_consensus.cc:2454] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:39:05.066599 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:05.065048 23533 leader_election.cc:302] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:39:05.056102 23532 leader_election.cc:302] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:05.010636 25357 leader_election.cc:288] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:05.068270 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:05.067397 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:05.070338 23480 raft_consensus.cc:2454] T 608f7e63bc4648e0890e5f601c52736c P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:39:05.073891 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:05.074883 23480 raft_consensus.cc:2454] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:39:05.076728 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:04.995360 25345 raft_consensus.cc:504] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.062498 25417 consensus_queue.cc:1035] T 4c074cd105794bf1a00bd3a9f449a323 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260807 13:39:05.033756 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:05.009255 25316 raft_consensus.cc:2781] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:39:05.077777 23480 raft_consensus.cc:2454] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 5.
I20260807 13:39:05.080406 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:05.081434 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faff067df57c4de49e89824bbc248751" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:05.105826 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:05.097229 23415 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Sending DeleteTablet for 3 replicas of tablet 11eba6f59d7f4541873d69ef88a0ad93
W20260807 13:39:05.079668 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 57915.8us
I20260807 13:39:05.106164 23581 raft_consensus.cc:3037] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:39:05.107081 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 51058us
I20260807 13:39:05.107343 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6ae70649fa43bba8052b66977418f5" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:05.108851 23572 raft_consensus.cc:2379] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 5: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:39:05.108934 23532 leader_election.cc:302] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:05.108973 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39707c5d97164544b9f5c03db41181c0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:05.110041 23480 raft_consensus.cc:2362] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2. Re-sending same reply.
I20260807 13:39:05.110240 23631 leader_election.cc:302] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:05.118794 23532 leader_election.cc:398] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Vote denied by peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037) with higher term. Message: Invalid argument: T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2.
I20260807 13:39:05.119323 23532 leader_election.cc:401] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 1 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:39:05.110106 23572 raft_consensus.cc:1226] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 5. Current term is 6. Ops: []
I20260807 13:39:05.099051 23575 raft_consensus.cc:3037] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:05.136308 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220c24fa0c52459182e1e89c74331f3b" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:05.139564 23415 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Sending DeleteTablet for 3 replicas of tablet 95c5e5bf2dd94ffc98d4ac0c6876c02e
I20260807 13:39:05.080701 23573 raft_consensus.cc:1226] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [term 7 LEADER]: Rejecting Update request from peer e11cad1eeaf5424c94e51241096f6613 for earlier term 6. Current term is 7. Ops: []
I20260807 13:39:05.090452 25377 raft_consensus.cc:482] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:05.111876 25155 raft_consensus.cc:2726] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:39:05.105258 25352 raft_consensus.cc:2726] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:39:05.151254 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a3da79d3b0447cbc19c4f28279e134" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:05.152983 23430 leader_election.cc:302] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:05.104863 23471 raft_consensus.cc:2454] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 1.
I20260807 13:39:05.091922 25316 raft_consensus.cc:482] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:05.118920 25301 raft_consensus.cc:2781] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:39:05.148440 23532 leader_election.cc:302] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:05.178220 23532 leader_election.cc:302] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:05.178275 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:05.170631 23430 leader_election.cc:302] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:05.090477 23470 raft_consensus.cc:2454] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 6.
I20260807 13:39:05.180475 23532 leader_election.cc:302] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:05.128237 25417 raft_consensus.cc:2781] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:39:05.168392 23581 raft_consensus.cc:2454] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:39:05.166777 23415 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Sending DeleteTablet for 3 replicas of tablet e20c3c18eb474ef5b19f3300b13b17c3
I20260807 13:39:05.101356 23670 tablet_service.cc:1514] Processing DeleteTablet for tablet fcdef01e85a44e1093dd335055986423 with delete_type TABLET_DATA_DELETED (Replaced by 0d7a01108a7042148334c054995cba3b at 2026-08-07 13:38:58 UTC) from {username='slave'} at 127.0.0.1:57108
I20260807 13:39:05.188465 23430 leader_election.cc:302] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:05.144639 25446 raft_consensus.cc:2781] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:39:05.184648 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:05.147624 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:05.183770 25417 raft_consensus.cc:482] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:05.197326 25417 raft_consensus.cc:3037] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:05.188654 25287 raft_consensus.cc:2726] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:39:05.177596 25357 raft_consensus.cc:2781] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:39:05.204094 23467 tablet_service.cc:1514] Processing DeleteTablet for tablet 95c5e5bf2dd94ffc98d4ac0c6876c02e with delete_type TABLET_DATA_DELETED (Replaced by 508c989e13ca4c47b5e2982478c5d328 at 2026-08-07 13:38:59 UTC) from {username='slave'} at 127.0.0.1:33966
I20260807 13:39:05.127588 25339 raft_consensus.cc:504] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.204259 25357 raft_consensus.cc:482] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:05.099262 23455 tablet_service.cc:1514] Processing DeleteTablet for tablet fcdef01e85a44e1093dd335055986423 with delete_type TABLET_DATA_DELETED (Replaced by 0d7a01108a7042148334c054995cba3b at 2026-08-07 13:38:58 UTC) from {username='slave'} at 127.0.0.1:33966
I20260807 13:39:05.176707 25316 raft_consensus.cc:3037] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:05.185161 25302 raft_consensus.cc:2726] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election lost for term 1. Reason: Vote denied by peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037) with higher term. Message: Invalid argument: T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2.
I20260807 13:39:05.171159 25372 raft_consensus.cc:2726] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:39:05.170346 25377 raft_consensus.cc:504] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
@ 0x7fc695305da9 testing::TestInfo::Run() at ??:0
I20260807 13:39:05.193794 25446 raft_consensus.cc:482] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:05.188423 23458 tablet_service.cc:1514] Processing DeleteTablet for tablet 11eba6f59d7f4541873d69ef88a0ad93 with delete_type TABLET_DATA_DELETED (Replaced by 566a7784d04c469483a0a06b376eb089 at 2026-08-07 13:38:59 UTC) from {username='slave'} at 127.0.0.1:33966
I20260807 13:39:05.190027 25323 raft_consensus.cc:504] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.191583 25331 raft_consensus.cc:2781] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:39:05.191829 25155 raft_consensus.cc:2781] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:39:05.194337 25301 raft_consensus.cc:686] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [term 5 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:39:05.193775 23575 raft_consensus.cc:2454] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4.
I20260807 13:39:05.310693 23475 raft_consensus.cc:2396] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260807 13:39:05.312367 23429 leader_election.cc:302] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:05.353423 23430 leader_election.cc:302] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:05.304232 25338 raft_consensus.cc:504] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.354709 23429 leader_election.cc:302] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:05.355785 25338 leader_election.cc:288] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:05.303984 24805 leader_election.cc:288] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:05.356552 25165 raft_consensus.cc:2781] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:39:05.301008 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e552e0aa3f4433858116fa31ee8458" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:05.357088 25165 raft_consensus.cc:686] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [term 4 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:39:05.358035 25165 consensus_queue.cc:237] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.358824 23471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 467) took 2379 ms. Trace:
I20260807 13:39:05.359987 23480 raft_consensus.cc:2379] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 2: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:39:05.361804 23475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 599) took 2110 ms. Trace:
I20260807 13:39:05.361974 25311 raft_consensus.cc:2726] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:39:05.355870 25291 raft_consensus.cc:2726] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260807 13:39:05.304379 25384 log.cc:924] Time spent T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 1.331s user 0.010s sys 0.001s
I20260807 13:39:05.315806 23472 raft_consensus.cc:2396] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260807 13:39:05.364645 25345 leader_election.cc:288] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 7 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:05.366526 23472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 468) took 1779 ms. Trace:
I20260807 13:39:05.316452 25446 raft_consensus.cc:3037] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:39:05.308295 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:05.368434 23470 raft_consensus.cc:2454] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:39:05.362232 23475 rpcz_store.cc:276] 0807 13:39:03.251740 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:05.360829 (+2109089us) service_pool.cc:227] Handling call
0807 13:39:05.361192 (+ 363us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:05.361504 (+ 312us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:05.361529 (+ 25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:05.361572 (+ 43us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:39:05.361601 (+ 29us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:05.361649 (+ 48us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:05.361743 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1287,"raft.run_cpu_time_us":47,"raft.run_wall_time_us":47}
I20260807 13:39:05.324637 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:05.328462 23481 raft_consensus.cc:1226] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 4. Current term is 5. Ops: []
I20260807 13:39:05.372764 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:05.373283 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a3da79d3b0447cbc19c4f28279e134" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:05.370193 23475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 469) took 1782 ms. Trace:
I20260807 13:39:05.374068 23475 rpcz_store.cc:276] 0807 13:39:03.587708 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:05.369389 (+1781681us) service_pool.cc:227] Handling call
0807 13:39:05.369708 (+ 319us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:05.369877 (+ 169us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:05.369914 (+ 37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:05.369954 (+ 40us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:05.369983 (+ 29us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:05.370041 (+ 58us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:05.370135 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:05.375136 23577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 492) took 1040 ms. Trace:
I20260807 13:39:05.373577 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:05.375602 23577 rpcz_store.cc:276] 0807 13:39:04.334435 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:04.420788 (+ 86353us) service_pool.cc:227] Handling call
0807 13:39:05.374919 (+954131us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b54002ee0d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:39:05.375045 (+ 126us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1410204544}
I20260807 13:39:05.376444 23575 raft_consensus.cc:2454] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:39:05.377120 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a3da79d3b0447cbc19c4f28279e134" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:05.333333 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:05.334311 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:05.380168 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:05.381328 23571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 489) took 1056 ms. Trace:
I20260807 13:39:05.381747 23571 rpcz_store.cc:276] 0807 13:39:04.325142 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:04.328921 (+ 3779us) service_pool.cc:227] Handling call
0807 13:39:05.379942 (+1051021us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:39:05.381245 (+ 1303us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5401856}
I20260807 13:39:05.383101 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:05.386224 23571 raft_consensus.cc:3037] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Advancing to term 5
W20260807 13:39:05.297811 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 92144.2us
I20260807 13:39:05.389359 23532 leader_election.cc:302] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:05.361804 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 600) took 2109 ms. Trace:
I20260807 13:39:05.390735 23480 rpcz_store.cc:276] 0807 13:39:03.252175 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:05.361047 (+2108872us) service_pool.cc:227] Handling call
0807 13:39:05.361332 (+ 285us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:05.361641 (+ 309us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:05.361754 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:05.315619 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:05.303946 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:05.395429 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:05.397351 23479 raft_consensus.cc:2396] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:39:05.394631 23532 leader_election.cc:302] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:05.398010 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:05.399487 23532 leader_election.cc:302] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:05.401556 23430 leader_election.cc:302] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
W20260807 13:39:05.403205 25405 log.cc:924] Time spent T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 1.077s user 0.003s sys 0.006s
@ 0x7fc695306d85 testing::TestSuite::Run() at ??:0
I20260807 13:39:05.334300 23669 tablet_service.cc:1514] Processing DeleteTablet for tablet e20c3c18eb474ef5b19f3300b13b17c3 with delete_type TABLET_DATA_DELETED (Replaced by e6d26fd195cb4bf4bd91ba45a72f87ac at 2026-08-07 13:38:59 UTC) from {username='slave'} at 127.0.0.1:57108
I20260807 13:39:05.318471 25265 raft_consensus.cc:482] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:05.297896 23659 tablet_service.cc:1514] Processing DeleteTablet for tablet 11eba6f59d7f4541873d69ef88a0ad93 with delete_type TABLET_DATA_DELETED (Replaced by 566a7784d04c469483a0a06b376eb089 at 2026-08-07 13:38:59 UTC) from {username='slave'} at 127.0.0.1:57108
I20260807 13:39:05.318043 25323 leader_election.cc:288] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:05.315346 23657 tablet_service.cc:1514] Processing DeleteTablet for tablet 95c5e5bf2dd94ffc98d4ac0c6876c02e with delete_type TABLET_DATA_DELETED (Replaced by 508c989e13ca4c47b5e2982478c5d328 at 2026-08-07 13:38:59 UTC) from {username='slave'} at 127.0.0.1:57108
I20260807 13:39:05.404089 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:05.292639 25357 raft_consensus.cc:3037] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:05.348253 25155 raft_consensus.cc:482] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:05.359221 23471 rpcz_store.cc:276] 0807 13:39:02.979904 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:05.357860 (+2377956us) service_pool.cc:227] Handling call
0807 13:39:05.358268 (+ 408us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:05.358461 (+ 193us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:05.358492 (+ 31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:05.358546 (+ 54us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:39:05.358579 (+ 33us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:05.358640 (+ 61us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:05.358768 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:05.406193 23479 raft_consensus.cc:1226] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 2. Ops: []
I20260807 13:39:05.314121 25339 leader_election.cc:288] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:05.408054 25442 raft_consensus.cc:2726] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:39:05.409228 23415 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Sending DeleteTablet for 3 replicas of tablet 220c24fa0c52459182e1e89c74331f3b
I20260807 13:39:05.460548 25359 consensus_queue.cc:1046] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:39:05.318917 25331 raft_consensus.cc:686] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:39:05.462428 25359 raft_consensus.cc:3032] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:39:05.462867 25359 raft_consensus.cc:729] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:05.463274 25331 consensus_queue.cc:237] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.465013 23631 leader_election.cc:302] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:05.366930 23472 rpcz_store.cc:276] 0807 13:39:03.587295 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:05.365521 (+1778226us) service_pool.cc:227] Handling call
0807 13:39:05.365896 (+ 375us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:05.366089 (+ 193us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:05.366123 (+ 34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:05.366173 (+ 50us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:39:05.366211 (+ 38us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:05.366306 (+ 95us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:05.366458 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:05.412897 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 464) took 2533 ms. Trace:
I20260807 13:39:05.467434 25040 raft_consensus.cc:2781] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:39:05.467993 25040 raft_consensus.cc:482] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:05.468549 25040 raft_consensus.cc:3037] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:05.467929 23481 rpcz_store.cc:276] 0807 13:39:02.879932 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:04.687107 (+1807175us) service_pool.cc:227] Handling call
0807 13:39:05.016374 (+329267us) spinlock_profiling.cc:243] Waited 9.23 ms on lock 0x7b5800003398. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:39:05.328240 (+311866us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:05.384961 (+ 56721us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:05.412614 (+ 27653us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b540011e250. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ea09 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:39:05.412789 (+ 175us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":737899264}
I20260807 13:39:05.316968 25377 leader_election.cc:288] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:05.415253 25345 raft_consensus.cc:2781] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:39:05.416358 23470 raft_consensus.cc:1226] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 5. Ops: []
I20260807 13:39:05.472172 23470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 614) took 1102 ms. Trace:
I20260807 13:39:05.472574 23470 rpcz_store.cc:276] 0807 13:39:04.369906 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:05.415683 (+1045777us) service_pool.cc:227] Handling call
0807 13:39:05.416161 (+ 478us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:05.471843 (+ 55682us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:05.472100 (+ 257us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:05.474714 23478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 441) took 4311 ms. Trace:
I20260807 13:39:05.320784 25402 raft_consensus.cc:482] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:05.476076 23657 tablet_service.cc:1514] Processing DeleteTablet for tablet 220c24fa0c52459182e1e89c74331f3b with delete_type TABLET_DATA_DELETED (Replaced by dd8a99f8a43a4481a51b4d339f14bfdc at 2026-08-07 13:38:59 UTC) from {username='slave'} at 127.0.0.1:57108
I20260807 13:39:05.419932 23430 leader_election.cc:302] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:05.327298 25025 leader_election.cc:288] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:05.471621 25345 raft_consensus.cc:482] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:39:05.477020 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 57184.5us
I20260807 13:39:05.434285 25265 raft_consensus.cc:504] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.353288 23675 raft_consensus.cc:3037] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:05.477919 25338 raft_consensus.cc:2781] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:39:05.478341 25338 raft_consensus.cc:482] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:05.478739 25338 raft_consensus.cc:3037] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:05.475217 23478 rpcz_store.cc:276] 0807 13:39:01.163158 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:03.790188 (+2627030us) service_pool.cc:227] Handling call
0807 13:39:03.790677 (+ 489us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:03.858615 (+ 67938us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:03.858648 (+ 33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:03.864479 (+ 5831us) log.cc:842] Serialized 26 byte log entry
0807 13:39:04.123104 (+258625us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:04.123152 (+ 48us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:04.411793 (+288641us) spinlock_profiling.cc:243] Waited 67.6 ms on lock 0x7b5400269dd4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:39:04.411848 (+ 55us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:05.402425 (+990577us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b44000232cc. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc695049a95 00007fc69504a4b2 00007fc697cf2511 00007fc697cede1a 00007fc697ce1bee 00007fc697ce0f36 00007fc697ce0b58 00007fc697cea551 00007fc697cea509 00007fc697cea499
0807 13:39:05.474405 (+ 71980us) raft_consensus.cc:1671] finished
0807 13:39:05.474436 (+ 31us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:05.474635 (+ 199us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1740,"raft.queue_time_us":495,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":83000,"spinlock_wait_cycles":162536576,"thread_start_us":258235,"threads_started":1,"wal-append.queue_time_us":397099}
I20260807 13:39:05.433610 24805 consensus_queue.cc:1035] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.049s
I20260807 13:39:05.205564 25306 raft_consensus.cc:2781] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:39:05.430840 23469 raft_consensus.cc:1226] T 608f7e63bc4648e0890e5f601c52736c P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 1. Current term is 3. Ops: []
I20260807 13:39:05.432792 23480 raft_consensus.cc:1226] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 2. Current term is 4. Ops: []
I20260807 13:39:05.438514 23532 leader_election.cc:302] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
W20260807 13:39:05.484263 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 45871.8us
I20260807 13:39:05.486315 23532 leader_election.cc:302] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:05.334573 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:05.455873 23455 tablet_service.cc:1514] Processing DeleteTablet for tablet e20c3c18eb474ef5b19f3300b13b17c3 with delete_type TABLET_DATA_DELETED (Replaced by e6d26fd195cb4bf4bd91ba45a72f87ac at 2026-08-07 13:38:59 UTC) from {username='slave'} at 127.0.0.1:33966
I20260807 13:39:05.458884 23633 leader_election.cc:302] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:05.459697 25322 consensus_queue.cc:1035] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:39:05.475977 25402 raft_consensus.cc:504] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.421139 23571 raft_consensus.cc:2454] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 5.
I20260807 13:39:05.518062 23571 raft_consensus.cc:1226] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 3. Current term is 4. Ops: []
I20260807 13:39:05.519387 23571 raft_consensus.cc:1226] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 7 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 6. Current term is 7. Ops: []
I20260807 13:39:05.312503 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e552e0aa3f4433858116fa31ee8458" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:05.477967 23430 leader_election.cc:302] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
W20260807 13:39:05.522743 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 44875.1us
I20260807 13:39:05.523814 23430 leader_election.cc:302] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:05.525326 23430 leader_election.cc:302] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:05.462466 23415 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Sending DeleteTablet for 3 replicas of tablet 8b6d649ae21a41c9b6723944d7036688
I20260807 13:39:05.429080 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:05.527148 23575 raft_consensus.cc:2379] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 4: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:39:05.488535 23479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 616) took 1118 ms. Trace:
I20260807 13:39:05.528214 23479 rpcz_store.cc:276] 0807 13:39:04.370473 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:05.405657 (+1035184us) service_pool.cc:227] Handling call
0807 13:39:05.406013 (+ 356us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:05.488183 (+ 82170us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:05.488459 (+ 276us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:05.495172 23469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 615) took 1125 ms. Trace:
I20260807 13:39:05.529410 23469 rpcz_store.cc:276] 0807 13:39:04.370183 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:05.399579 (+1029396us) service_pool.cc:227] Handling call
0807 13:39:05.430663 (+ 31084us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:05.494794 (+ 64131us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:05.495084 (+ 290us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:05.531178 23469 raft_consensus.cc:1261] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:39:05.496078 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 613) took 1126 ms. Trace:
I20260807 13:39:05.531919 23480 rpcz_store.cc:276] 0807 13:39:04.369652 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:05.391891 (+1022239us) service_pool.cc:227] Handling call
0807 13:39:05.432641 (+ 40750us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:05.495755 (+ 63114us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:05.496006 (+ 251us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:05.429278 25287 raft_consensus.cc:2781] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260807 13:39:05.512537 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 53740us
I20260807 13:39:05.513037 23532 leader_election.cc:302] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:05.477218 25345 raft_consensus.cc:3037] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:39:05.436220 25409 raft_consensus.cc:3037] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:05.487993 25155 raft_consensus.cc:3037] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:05.534914 23573 raft_consensus.cc:2454] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 2.
I20260807 13:39:05.349453 25301 consensus_queue.cc:237] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.545688 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:05.547541 23633 leader_election.cc:302] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:05.550519 23430 leader_election.cc:302] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:05.556775 23415 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Sending DeleteTablet for 3 replicas of tablet 4996c3c52ccc41b9a8da11ca747a8e6a
I20260807 13:39:05.560734 25410 raft_consensus.cc:2726] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 13:39:05.516726 25276 raft_consensus.cc:2726] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:39:05.535387 25304 raft_consensus.cc:3037] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:05.542557 25442 raft_consensus.cc:2726] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:39:05.540764 25265 leader_election.cc:288] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:05.553007 25025 consensus_queue.cc:1035] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.015s
I20260807 13:39:05.571758 25302 raft_consensus.cc:482] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:05.537998 25352 raft_consensus.cc:2781] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:39:05.535681 25306 raft_consensus.cc:686] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:39:05.535120 25339 raft_consensus.cc:2726] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:05.578661 23575 raft_consensus.cc:1261] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:39:05.535409 25287 raft_consensus.cc:482] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:05.535511 25377 raft_consensus.cc:2726] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260807 13:39:05.589921 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 52923.6us
I20260807 13:39:05.541723 25400 consensus_queue.cc:1046] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260807 13:39:05.604442 23415 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Sending DeleteTablet for 3 replicas of tablet b9fcdd060ef64874a8719c95b2325942
I20260807 13:39:05.588605 23574 raft_consensus.cc:2379] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 1: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:39:05.566087 25326 raft_consensus.cc:2726] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:39:05.599889 23455 tablet_service.cc:1514] Processing DeleteTablet for tablet 220c24fa0c52459182e1e89c74331f3b with delete_type TABLET_DATA_DELETED (Replaced by dd8a99f8a43a4481a51b4d339f14bfdc at 2026-08-07 13:38:59 UTC) from {username='slave'} at 127.0.0.1:33966
I20260807 13:39:05.546840 25316 raft_consensus.cc:504] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.613034 23458 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b6d649ae21a41c9b6723944d7036688 with delete_type TABLET_DATA_DELETED (Replaced by 23e06eb23c7549ca833574823dc2f8a1 at 2026-08-07 13:38:59 UTC) from {username='slave'} at 127.0.0.1:33966
I20260807 13:39:05.339607 25417 raft_consensus.cc:504] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.589905 24873 raft_consensus.cc:2726] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:05.587062 23472 raft_consensus.cc:1261] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:39:05.520248 25359 consensus_queue.cc:260] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.614939 25287 raft_consensus.cc:3037] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:39:05.661374 23415 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Sending DeleteTablet for 3 replicas of tablet 356c6b3e51454d418acaa9be70bb9689
I20260807 13:39:05.605075 25302 raft_consensus.cc:504] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.685292 23465 tablet_service.cc:1514] Processing DeleteTablet for tablet 4996c3c52ccc41b9a8da11ca747a8e6a with delete_type TABLET_DATA_DELETED (Replaced by 24d412bb0b294eeaabde57c850783dab at 2026-08-07 13:38:59 UTC) from {username='slave'} at 127.0.0.1:33966
I20260807 13:39:05.687041 25040 raft_consensus.cc:504] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.688606 25339 raft_consensus.cc:482] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:05.689222 25040 leader_election.cc:288] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:05.689097 25339 raft_consensus.cc:504] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.690325 25400 raft_consensus.cc:3032] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:39:05.690691 25400 raft_consensus.cc:729] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:05.691115 25339 leader_election.cc:288] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:05.692071 25402 leader_election.cc:288] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:05.692611 25402 consensus_queue.cc:1035] T ce381b59fcae417a87681d73e12ca9ea P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:05.692091 23677 raft_consensus.cc:2354] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4.
I20260807 13:39:05.691514 25400 consensus_queue.cc:260] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.696412 25400 raft_consensus.cc:3037] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:05.697221 25446 raft_consensus.cc:504] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.642289 25443 raft_consensus.cc:2726] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:39:05.664505 25326 consensus_queue.cc:1035] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260807 13:39:05.700043 23670 tablet_service.cc:1514] Processing DeleteTablet for tablet 4996c3c52ccc41b9a8da11ca747a8e6a with delete_type TABLET_DATA_DELETED (Replaced by 24d412bb0b294eeaabde57c850783dab at 2026-08-07 13:38:59 UTC) from {username='slave'} at 127.0.0.1:57108
I20260807 13:39:05.699786 25306 consensus_queue.cc:237] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:05.701855 25434 consensus_queue.cc:1159] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9ae273efd33642ad970ab8d1973917c1" responder_term: 4 status { last_received { term: 4 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 4 index: 2 } }
I20260807 13:39:05.704903 23679 raft_consensus.cc:1226] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 5. Current term is 6. Ops: []
I20260807 13:39:05.645038 23471 raft_consensus.cc:1226] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2. Ops: []
I20260807 13:39:05.646008 23675 raft_consensus.cc:2454] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4.
I20260807 13:39:05.711067 25316 leader_election.cc:288] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:05.645344 23657 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b6d649ae21a41c9b6723944d7036688 with delete_type TABLET_DATA_DELETED (Replaced by 23e06eb23c7549ca833574823dc2f8a1 at 2026-08-07 13:38:59 UTC) from {username='slave'} at 127.0.0.1:57108
I20260807 13:39:05.655005 23573 raft_consensus.cc:1226] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 4. Current term is 5. Ops: []
I20260807 13:39:05.754988 23415 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Sending DeleteTablet for 3 replicas of tablet 05a3da79d3b0447cbc19c4f28279e134
I20260807 13:39:05.643033 25361 consensus_queue.cc:1046] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.103s
I20260807 13:39:05.758754 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:05.759539 23575 raft_consensus.cc:2379] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 7: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:39:05.766213 23657 tablet_service.cc:1514] Processing DeleteTablet for tablet b9fcdd060ef64874a8719c95b2325942 with delete_type TABLET_DATA_DELETED (Replaced by cea21e439be142e588f12ee16d5f71b1 at 2026-08-07 13:38:59 UTC) from {username='slave'} at 127.0.0.1:57108
I20260807 13:39:05.757100 23465 tablet_service.cc:1514] Processing DeleteTablet for tablet 356c6b3e51454d418acaa9be70bb9689 with delete_type TABLET_DATA_DELETED (Replaced by 2d4dd3ca60c94d7e891841088eb8f765 at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:33966
I20260807 13:39:05.770339 25409 raft_consensus.cc:2726] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:05.772085 23657 tablet_service.cc:1514] Processing DeleteTablet for tablet 356c6b3e51454d418acaa9be70bb9689 with delete_type TABLET_DATA_DELETED (Replaced by 2d4dd3ca60c94d7e891841088eb8f765 at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:57108
I20260807 13:39:05.773661 25446 leader_election.cc:288] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:05.780005 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:05.780128 25287 raft_consensus.cc:504] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.784009 23467 tablet_service.cc:1514] Processing DeleteTablet for tablet b9fcdd060ef64874a8719c95b2325942 with delete_type TABLET_DATA_DELETED (Replaced by cea21e439be142e588f12ee16d5f71b1 at 2026-08-07 13:38:59 UTC) from {username='slave'} at 127.0.0.1:33966
I20260807 13:39:05.789526 25302 leader_election.cc:288] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:05.791625 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:05.795670 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:05.798063 23471 raft_consensus.cc:2379] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 4: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:39:05.798216 25471 tablet_replica.cc:330] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a: stopping tablet replica
I20260807 13:39:05.799140 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:05.799834 23471 raft_consensus.cc:3037] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:05.716177 23472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 617) took 1345 ms. Trace:
I20260807 13:39:05.812601 23415 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Sending DeleteTablet for 3 replicas of tablet faff067df57c4de49e89824bbc248751
I20260807 13:39:05.820487 23415 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Sending DeleteTablet for 3 replicas of tablet b078a19f38494b04ad11b14d98ec4bca
I20260807 13:39:05.812089 25326 raft_consensus.cc:482] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:05.811522 25377 raft_consensus.cc:482] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:05.828583 23473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 470) took 2240 ms. Trace:
I20260807 13:39:05.829144 23473 rpcz_store.cc:276] 0807 13:39:03.681951 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:05.371259 (+1689308us) service_pool.cc:227] Handling call
0807 13:39:05.371678 (+ 419us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:05.371915 (+ 237us) raft_consensus.cc:1520] Early marking committed up to index 1
0807 13:39:05.647468 (+275553us) log.cc:842] Serialized 14 byte log entry
0807 13:39:05.828112 (+180644us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:05.828181 (+ 69us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:05.828239 (+ 58us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:05.828329 (+ 90us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:05.828502 (+ 173us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2273,"thread_start_us":432787,"threads_started":2}
I20260807 13:39:05.830809 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:05.831523 23473 raft_consensus.cc:3037] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:05.877475 23465 tablet_service.cc:1514] Processing DeleteTablet for tablet faff067df57c4de49e89824bbc248751 with delete_type TABLET_DATA_DELETED (Replaced by f40430392f094845a0d657f677860f4d at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:33966
I20260807 13:39:05.877764 23657 tablet_service.cc:1514] Processing DeleteTablet for tablet 05a3da79d3b0447cbc19c4f28279e134 with delete_type TABLET_DATA_DELETED (Replaced by 46cd5d7fc0cd4f06aa175ad4406c7845 at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:57108
I20260807 13:39:05.880126 25287 leader_election.cc:288] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:05.888125 23415 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Sending DeleteTablet for 3 replicas of tablet ea6ae70649fa43bba8052b66977418f5
I20260807 13:39:05.889416 23471 raft_consensus.cc:2454] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 5.
I20260807 13:39:05.889855 23415 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Sending DeleteTablet for 3 replicas of tablet 39707c5d97164544b9f5c03db41181c0
W20260807 13:39:05.890113 25461 log.cc:924] Time spent T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.090s user 0.001s sys 0.002s
I20260807 13:39:05.890549 23471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:05.891237 23471 raft_consensus.cc:3037] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Advancing to term 7
@ 0x7fc69531b875 testing::internal::UnitTestImpl::RunAllTests() at ??:0
I20260807 13:39:05.814214 25443 consensus_queue.cc:1046] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260807 13:39:05.820420 25410 raft_consensus.cc:482] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:05.896325 25410 raft_consensus.cc:504] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.896843 23657 tablet_service.cc:1514] Processing DeleteTablet for tablet faff067df57c4de49e89824bbc248751 with delete_type TABLET_DATA_DELETED (Replaced by f40430392f094845a0d657f677860f4d at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:57108
I20260807 13:39:05.898408 25410 leader_election.cc:288] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:05.899158 23659 tablet_service.cc:1514] Processing DeleteTablet for tablet 39707c5d97164544b9f5c03db41181c0 with delete_type TABLET_DATA_DELETED (Replaced by 02cac2e1f00446668f33a2bf5fbbd4de at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:57108
I20260807 13:39:05.860307 25372 raft_consensus.cc:482] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:05.902872 25372 raft_consensus.cc:504] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.903971 23670 tablet_service.cc:1514] Processing DeleteTablet for tablet ea6ae70649fa43bba8052b66977418f5 with delete_type TABLET_DATA_DELETED (Replaced by f6cf62903437494c9280c9bf34653cb1 at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:57108
I20260807 13:39:05.905126 23657 tablet_service.cc:1514] Processing DeleteTablet for tablet b078a19f38494b04ad11b14d98ec4bca with delete_type TABLET_DATA_DELETED (Replaced by c9b09df756c14aa29e17459696a886a1 at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:57108
I20260807 13:39:05.906761 25417 leader_election.cc:288] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:05.860613 25326 raft_consensus.cc:504] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.909417 25434 raft_consensus.cc:482] T 4996c3c52ccc41b9a8da11ca747a8e6a P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:05.909651 25326 leader_election.cc:288] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:05.826193 23467 tablet_service.cc:1514] Processing DeleteTablet for tablet 05a3da79d3b0447cbc19c4f28279e134 with delete_type TABLET_DATA_DELETED (Replaced by 46cd5d7fc0cd4f06aa175ad4406c7845 at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:33966
I20260807 13:39:05.909996 25434 raft_consensus.cc:504] T 4996c3c52ccc41b9a8da11ca747a8e6a P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.911013 25155 raft_consensus.cc:504] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:05.912267 25457 log.cc:924] Time spent T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.312s user 0.002s sys 0.000s
I20260807 13:39:05.881677 25339 raft_consensus.cc:482] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:05.913586 25339 raft_consensus.cc:504] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.891433 23415 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Sending DeleteTablet for 3 replicas of tablet 46e552e0aa3f4433858116fa31ee8458
I20260807 13:39:05.920689 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:05.912701 25338 raft_consensus.cc:504] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.922216 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:05.923077 23671 raft_consensus.cc:2396] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260807 13:39:05.923382 23533 leader_election.cc:398] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765) with higher term. Message: Invalid argument: T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4.
I20260807 13:39:05.923700 23533 leader_election.cc:401] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:39:05.948836 23571 raft_consensus.cc:1226] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 3. Current term is 4. Ops: []
I20260807 13:39:05.880743 25357 raft_consensus.cc:504] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.807453 23472 rpcz_store.cc:276] 0807 13:39:04.370822 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:05.467190 (+1096368us) service_pool.cc:227] Handling call
0807 13:39:05.467618 (+ 428us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:05.644642 (+177024us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:05.681912 (+ 37270us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:05.962574 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:05.959821 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:05.972792 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:05.976779 23532 leader_election.cc:302] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
W20260807 13:39:05.992390 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 69143.7us
I20260807 13:39:05.993326 23415 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Sending DeleteTablet for 3 replicas of tablet 7cd369f3fbdf4b61a5fd1e85690c9ba4
I20260807 13:39:05.939896 25287 raft_consensus.cc:482] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:05.960700 25367 raft_consensus.cc:482] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:05.995234 23532 leader_election.cc:302] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
W20260807 13:39:06.013552 23407 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:39:05.875568 25377 raft_consensus.cc:504] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:05.989009 23465 tablet_service.cc:1514] Processing DeleteTablet for tablet ea6ae70649fa43bba8052b66977418f5 with delete_type TABLET_DATA_DELETED (Replaced by f6cf62903437494c9280c9bf34653cb1 at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:33966
I20260807 13:39:06.008445 23458 tablet_service.cc:1514] Processing DeleteTablet for tablet 39707c5d97164544b9f5c03db41181c0 with delete_type TABLET_DATA_DELETED (Replaced by 02cac2e1f00446668f33a2bf5fbbd4de at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:33966
I20260807 13:39:05.990037 25410 raft_consensus.cc:482] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:06.018548 25287 raft_consensus.cc:504] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:39:06.019227 23415 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Sending DeleteTablet for 3 replicas of tablet 2b1542e790794928a76e4b29a1d7732b
I20260807 13:39:06.019662 25339 leader_election.cc:288] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:06.015447 23467 tablet_service.cc:1514] Processing DeleteTablet for tablet b078a19f38494b04ad11b14d98ec4bca with delete_type TABLET_DATA_DELETED (Replaced by c9b09df756c14aa29e17459696a886a1 at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:33966
W20260807 13:39:06.021098 25452 log.cc:924] Time spent T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.474s user 0.003s sys 0.000s
I20260807 13:39:06.021778 23473 raft_consensus.cc:2454] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 5.
I20260807 13:39:05.969894 25445 raft_consensus.cc:482] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:05.989238 24805 raft_consensus.cc:3032] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:39:05.989351 25323 raft_consensus.cc:482] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:06.017405 23532 leader_election.cc:302] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:05.989800 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6c8df560094315891e2805f0b21791" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:06.055943 25445 raft_consensus.cc:504] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.061493 23573 raft_consensus.cc:3037] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:39:06.055956 23464 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cd369f3fbdf4b61a5fd1e85690c9ba4 with delete_type TABLET_DATA_DELETED (Replaced by 1bef6ef007eb4dd18759fb406e70535c at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:33966
I20260807 13:39:06.063027 25445 leader_election.cc:288] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:06.063242 25339 raft_consensus.cc:482] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:06.018316 23455 tablet_service.cc:1514] Processing DeleteTablet for tablet 46e552e0aa3f4433858116fa31ee8458 with delete_type TABLET_DATA_DELETED (Replaced by 19ee3f9a953c4bbd889fc7001a63fec1 at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:33966
I20260807 13:39:06.052055 24805 raft_consensus.cc:729] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:39:06.063756 25339 raft_consensus.cc:504] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.064360 24805 consensus_queue.cc:260] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.065658 24805 raft_consensus.cc:3037] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:39:06.065930 25339 leader_election.cc:288] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:05.964845 25400 consensus_queue.cc:1046] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.051s
I20260807 13:39:06.067214 25400 raft_consensus.cc:3032] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:39:06.066926 25323 raft_consensus.cc:504] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.068053 25287 leader_election.cc:288] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:06.067597 25400 raft_consensus.cc:729] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:06.069051 25323 leader_election.cc:288] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:06.069183 25155 leader_election.cc:288] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:06.038091 25409 raft_consensus.cc:3037] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 4
I20260807 13:39:06.054020 23429 leader_election.cc:302] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:06.015558 25316 raft_consensus.cc:2726] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:39:06.025862 23657 tablet_service.cc:1514] Processing DeleteTablet for tablet 46e552e0aa3f4433858116fa31ee8458 with delete_type TABLET_DATA_DELETED (Replaced by 19ee3f9a953c4bbd889fc7001a63fec1 at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:57108
I20260807 13:39:05.994831 25025 raft_consensus.cc:482] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
W20260807 13:39:06.044050 23481 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s user 0.015s sys 0.010s
W20260807 13:39:06.079376 23481 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s user 0.016s sys 0.011s
I20260807 13:39:06.044845 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:06.049302 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:06.024838 25367 raft_consensus.cc:504] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.046494 23582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 487) took 1026 ms. Trace:
I20260807 13:39:06.008934 25265 raft_consensus.cc:482] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:06.064230 23670 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cd369f3fbdf4b61a5fd1e85690c9ba4 with delete_type TABLET_DATA_DELETED (Replaced by 1bef6ef007eb4dd18759fb406e70535c at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:57108
I20260807 13:39:06.092115 23582 rpcz_store.cc:276] 0807 13:39:05.019579 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:05.019775 (+ 196us) service_pool.cc:227] Handling call
0807 13:39:05.031564 (+ 11789us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:05.031821 (+ 257us) raft_consensus.cc:1520] Early marking committed up to index 3
0807 13:39:05.164272 (+132451us) log.cc:842] Serialized 14 byte log entry
0807 13:39:05.888722 (+724450us) spinlock_profiling.cc:243] Waited 5.37 ms on lock 0x7b44000232cc. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc695049a95 00007fc69504a4b2 00007fc697cf2511 00007fc697cede1a 00007fc697ce1bee 00007fc697ce0f36 00007fc697ce0b58 00007fc697cea551 00007fc697cea509 00007fc697cea499
0807 13:39:06.039166 (+150444us) log.cc:842] Serialized 14 byte log entry
0807 13:39:06.046106 (+ 6940us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:06.046165 (+ 59us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:39:06.046214 (+ 49us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:06.046284 (+ 70us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:06.046413 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":33327,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":121,"raft.queue_time_us":23424,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":9841,"spinlock_wait_cycles":12353920,"thread_start_us":996795,"threads_started":3,"wal-append.queue_time_us":634610}
W20260807 13:39:06.088328 23581 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.503s user 0.007s sys 0.015s
I20260807 13:39:06.027920 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:06.090870 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:06.046347 25372 leader_election.cc:288] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:06.100132 23473 raft_consensus.cc:2454] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4.
I20260807 13:39:06.100279 23577 raft_consensus.cc:1226] T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 13:39:06.101117 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:06.030313 25302 consensus_queue.cc:1046] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.044s
W20260807 13:39:06.096880 23581 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.512s user 0.007s sys 0.015s
I20260807 13:39:06.071334 25443 raft_consensus.cc:2726] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:39:06.108405 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:06.070148 25434 leader_election.cc:288] T 4996c3c52ccc41b9a8da11ca747a8e6a P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:06.042492 25410 raft_consensus.cc:504] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.089512 25304 raft_consensus.cc:2726] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:39:06.101802 23455 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b1542e790794928a76e4b29a1d7732b with delete_type TABLET_DATA_DELETED (Replaced by e2a4ce7bb4d64b8596158d5ac194e4a9 at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:33966
I20260807 13:39:06.102444 25155 raft_consensus.cc:482] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:06.092664 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4996c3c52ccc41b9a8da11ca747a8e6a" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:06.121191 23631 leader_election.cc:302] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:06.127233 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4996c3c52ccc41b9a8da11ca747a8e6a" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:06.120301 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b1542e790794928a76e4b29a1d7732b" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:06.133616 23475 raft_consensus.cc:1226] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2. Ops: []
I20260807 13:39:06.135349 23473 raft_consensus.cc:2379] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 2: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
W20260807 13:39:06.121318 23478 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.639s user 0.008s sys 0.032s
W20260807 13:39:06.143036 23478 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.660s user 0.008s sys 0.032s
I20260807 13:39:06.091876 25025 raft_consensus.cc:504] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.129458 25468 tablet_replica.cc:330] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613: stopping tablet replica
I20260807 13:39:06.101145 25339 consensus_queue.cc:1035] T 46e552e0aa3f4433858116fa31ee8458 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260807 13:39:06.112638 25352 raft_consensus.cc:686] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 5 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:39:06.102635 25265 raft_consensus.cc:504] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.106130 25400 consensus_queue.cc:260] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:06.219573 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 159001us
I20260807 13:39:06.131412 23472 raft_consensus.cc:2379] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:39:06.237164 23532 leader_election.cc:302] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:06.117643 25357 leader_election.cc:288] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:06.116580 25482 raft_consensus.cc:482] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:06.243836 23532 leader_election.cc:302] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:06.167321 25487 raft_consensus.cc:3032] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:39:06.248417 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:06.258483 25487 raft_consensus.cc:729] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:39:06.258757 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b1542e790794928a76e4b29a1d7732b" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:06.116467 25331 raft_consensus.cc:2781] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:39:06.259867 25331 raft_consensus.cc:686] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 5 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:39:06.259455 25487 consensus_queue.cc:260] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.260761 25487 raft_consensus.cc:3037] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:06.260854 25331 consensus_queue.cc:237] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.249823 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:39:06.235796 25165 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.822s user 0.005s sys 0.033s
I20260807 13:39:06.263734 23561 tablet_service.cc:1514] Processing DeleteTablet for tablet 95c5e5bf2dd94ffc98d4ac0c6876c02e with delete_type TABLET_DATA_DELETED (Replaced by 508c989e13ca4c47b5e2982478c5d328 at 2026-08-07 13:38:59 UTC) from {username='slave'} at 127.0.0.1:49032
W20260807 13:39:06.264015 25165 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.850s user 0.005s sys 0.033s
I20260807 13:39:06.263928 23559 tablet_service.cc:1514] Processing DeleteTablet for tablet e20c3c18eb474ef5b19f3300b13b17c3 with delete_type TABLET_DATA_DELETED (Replaced by e6d26fd195cb4bf4bd91ba45a72f87ac at 2026-08-07 13:38:59 UTC) from {username='slave'} at 127.0.0.1:49032
W20260807 13:39:06.218179 25493 log.cc:924] Time spent T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.083s user 0.001s sys 0.000s
I20260807 13:39:06.264644 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:06.265324 23580 raft_consensus.cc:2454] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:39:06.144444 25443 raft_consensus.cc:482] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:06.266119 25322 raft_consensus.cc:3032] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:39:06.266530 25322 raft_consensus.cc:729] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:06.266623 25443 raft_consensus.cc:504] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.267774 23563 tablet_service.cc:1514] Processing DeleteTablet for tablet b9fcdd060ef64874a8719c95b2325942 with delete_type TABLET_DATA_DELETED (Replaced by cea21e439be142e588f12ee16d5f71b1 at 2026-08-07 13:38:59 UTC) from {username='slave'} at 127.0.0.1:49032
I20260807 13:39:06.268448 23575 raft_consensus.cc:1261] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:39:06.268565 23563 tablet_service.cc:1514] Processing DeleteTablet for tablet b078a19f38494b04ad11b14d98ec4bca with delete_type TABLET_DATA_DELETED (Replaced by c9b09df756c14aa29e17459696a886a1 at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:49032
I20260807 13:39:06.268863 25443 leader_election.cc:288] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:06.269304 23563 tablet_service.cc:1514] Processing DeleteTablet for tablet ea6ae70649fa43bba8052b66977418f5 with delete_type TABLET_DATA_DELETED (Replaced by f6cf62903437494c9280c9bf34653cb1 at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:49032
I20260807 13:39:06.269418 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:06.269661 25359 raft_consensus.cc:3037] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:06.269954 23563 tablet_service.cc:1514] Processing DeleteTablet for tablet 39707c5d97164544b9f5c03db41181c0 with delete_type TABLET_DATA_DELETED (Replaced by 02cac2e1f00446668f33a2bf5fbbd4de at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:49032
I20260807 13:39:06.266161 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:06.270570 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:06.270819 23580 raft_consensus.cc:2454] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4.
I20260807 13:39:06.271101 23567 tablet_service.cc:1514] Processing DeleteTablet for tablet 220c24fa0c52459182e1e89c74331f3b with delete_type TABLET_DATA_DELETED (Replaced by dd8a99f8a43a4481a51b4d339f14bfdc at 2026-08-07 13:38:59 UTC) from {username='slave'} at 127.0.0.1:49032
I20260807 13:39:06.271221 23575 raft_consensus.cc:2454] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4.
I20260807 13:39:06.264816 23559 tablet_service.cc:1514] Processing DeleteTablet for tablet faff067df57c4de49e89824bbc248751 with delete_type TABLET_DATA_DELETED (Replaced by f40430392f094845a0d657f677860f4d at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:49032
I20260807 13:39:06.255155 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:06.256067 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:06.270658 23563 tablet_service.cc:1514] Processing DeleteTablet for tablet 46e552e0aa3f4433858116fa31ee8458 with delete_type TABLET_DATA_DELETED (Replaced by 19ee3f9a953c4bbd889fc7001a63fec1 at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:49032
I20260807 13:39:06.271889 23567 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cd369f3fbdf4b61a5fd1e85690c9ba4 with delete_type TABLET_DATA_DELETED (Replaced by 1bef6ef007eb4dd18759fb406e70535c at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:49032
I20260807 13:39:06.272279 23562 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b6d649ae21a41c9b6723944d7036688 with delete_type TABLET_DATA_DELETED (Replaced by 23e06eb23c7549ca833574823dc2f8a1 at 2026-08-07 13:38:59 UTC) from {username='slave'} at 127.0.0.1:49032
I20260807 13:39:06.272729 23564 tablet_service.cc:1514] Processing DeleteTablet for tablet 4996c3c52ccc41b9a8da11ca747a8e6a with delete_type TABLET_DATA_DELETED (Replaced by 24d412bb0b294eeaabde57c850783dab at 2026-08-07 13:38:59 UTC) from {username='slave'} at 127.0.0.1:49032
I20260807 13:39:06.273589 23464 tablet_service.cc:1467] Processing CreateTablet for tablet 0d7a01108a7042148334c054995cba3b (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260807 13:39:06.144374 25338 leader_election.cc:288] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:06.156519 25434 raft_consensus.cc:2781] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:39:06.276939 23469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 480) took 1163 ms. Trace:
I20260807 13:39:06.247300 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4996c3c52ccc41b9a8da11ca747a8e6a" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:06.259358 23578 raft_consensus.cc:3037] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:06.192024 23565 tablet_service.cc:1514] Processing DeleteTablet for tablet 11eba6f59d7f4541873d69ef88a0ad93 with delete_type TABLET_DATA_DELETED (Replaced by 566a7784d04c469483a0a06b376eb089 at 2026-08-07 13:38:59 UTC) from {username='slave'} at 127.0.0.1:49032
I20260807 13:39:06.195101 23570 tablet_service.cc:1514] Processing DeleteTablet for tablet 356c6b3e51454d418acaa9be70bb9689 with delete_type TABLET_DATA_DELETED (Replaced by 2d4dd3ca60c94d7e891841088eb8f765 at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:49032
I20260807 13:39:06.201371 23566 tablet_service.cc:1514] Processing DeleteTablet for tablet fcdef01e85a44e1093dd335055986423 with delete_type TABLET_DATA_DELETED (Replaced by 0d7a01108a7042148334c054995cba3b at 2026-08-07 13:38:58 UTC) from {username='slave'} at 127.0.0.1:49032
I20260807 13:39:06.276225 25326 raft_consensus.cc:482] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:06.358898 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:06.360296 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:39:06.360911 25476 log.cc:924] Time spent T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.561s user 0.001s sys 0.005s
I20260807 13:39:06.362182 23470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 634) took 1668 ms. Trace:
I20260807 13:39:06.257593 25482 raft_consensus.cc:504] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.246833 25483 raft_consensus.cc:2781] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:39:06.276345 25490 raft_consensus.cc:482] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:06.298840 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 481) took 1184 ms. Trace:
W20260807 13:39:06.298273 25496 log.cc:924] Time spent T 608f7e63bc4648e0890e5f601c52736c P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.058s user 0.001s sys 0.000s
I20260807 13:39:06.380134 25483 raft_consensus.cc:686] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 5 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:39:06.381318 25165 raft_consensus.cc:482] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:06.381282 25483 consensus_queue.cc:237] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.382038 25165 raft_consensus.cc:504] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.156533 23675 raft_consensus.cc:2454] T 4996c3c52ccc41b9a8da11ca747a8e6a P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:39:06.277587 25291 raft_consensus.cc:482] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:06.303673 25498 raft_consensus.cc:482] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:06.250576 25377 leader_election.cc:288] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:06.145552 25155 raft_consensus.cc:504] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:06.313265 25475 log.cc:924] Time spent T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.057s user 0.000s sys 0.000s
I20260807 13:39:06.313786 23560 tablet_service.cc:1514] Processing DeleteTablet for tablet 05a3da79d3b0447cbc19c4f28279e134 with delete_type TABLET_DATA_DELETED (Replaced by 46cd5d7fc0cd4f06aa175ad4406c7845 at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:49032
I20260807 13:39:06.264859 25304 raft_consensus.cc:2726] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:39:06.284686 25400 raft_consensus.cc:3037] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:06.314214 23559 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b1542e790794928a76e4b29a1d7732b with delete_type TABLET_DATA_DELETED (Replaced by e2a4ce7bb4d64b8596158d5ac194e4a9 at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:49032
I20260807 13:39:06.333333 23464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d7a01108a7042148334c054995cba3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:06.333115 25287 raft_consensus.cc:482] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:06.315021 25434 raft_consensus.cc:482] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:06.408032 25434 raft_consensus.cc:3037] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:06.347447 25492 raft_consensus.cc:482] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:06.387877 25490 raft_consensus.cc:504] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.409677 25492 raft_consensus.cc:504] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.313251 23567 tablet_service.cc:1467] Processing CreateTablet for tablet 0d7a01108a7042148334c054995cba3b (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260807 13:39:06.354888 25491 raft_consensus.cc:482] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:06.424973 23577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 494) took 1237 ms. Trace:
I20260807 13:39:06.425585 23475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 472) took 2742 ms. Trace:
I20260807 13:39:06.426074 23475 rpcz_store.cc:276] 0807 13:39:03.682863 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:05.375011 (+1692148us) service_pool.cc:227] Handling call
0807 13:39:05.399078 (+ 24067us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:06.145964 (+746886us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:06.425263 (+279299us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b5400085f54. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:39:06.425506 (+ 243us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1688710912}
I20260807 13:39:06.126555 25316 consensus_queue.cc:1035] T d1bcab9bf8fc4a508a914326892a42a9 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.126s
I20260807 13:39:06.362618 23470 rpcz_store.cc:276] 0807 13:39:04.693270 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:05.473504 (+780234us) service_pool.cc:227] Handling call
0807 13:39:05.473968 (+ 464us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:05.474415 (+ 447us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:05.474462 (+ 47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:05.475039 (+ 577us) log.cc:842] Serialized 26 byte log entry
0807 13:39:05.711982 (+236943us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:39:06.101452 (+389470us) log.cc:842] Serialized 14 byte log entry
0807 13:39:06.333880 (+232428us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:06.333979 (+ 99us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:06.360309 (+ 26330us) spinlock_profiling.cc:243] Waited 8.14 ms on lock 0x7b44000232cc. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc695049a95 00007fc69504a4b2 00007fc697cf2511 00007fc697cede1a 00007fc697ce1bee 00007fc697ce0f36 00007fc697ce0b58 00007fc697cea551 00007fc697cea509 00007fc697cea499
0807 13:39:06.361821 (+ 1512us) raft_consensus.cc:1671] finished
0807 13:39:06.361947 (+ 126us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:06.362102 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":225827,"prepare.queue_time_us":166663,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":229553,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":185,"spinlock_wait_cycles":18723584,"thread_start_us":568602,"threads_started":2,"wal-append.queue_time_us":324367}
I20260807 13:39:06.372905 23480 rpcz_store.cc:276] 0807 13:39:05.113971 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:05.552336 (+438365us) service_pool.cc:227] Handling call
0807 13:39:05.589402 (+ 37066us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:05.589618 (+ 216us) raft_consensus.cc:1520] Early marking committed up to index 3
0807 13:39:05.941174 (+351556us) log.cc:842] Serialized 14 byte log entry
0807 13:39:06.298455 (+357281us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:06.298513 (+ 58us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:39:06.298556 (+ 43us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:06.298633 (+ 77us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:06.298779 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":60959,"prepare.queue_time_us":288987,"prepare.run_cpu_time_us":21,"prepare.run_wall_time_us":22,"raft.queue_time_us":85219,"spinlock_wait_cycles":97121920,"thread_start_us":627685,"threads_started":2,"wal-append.queue_time_us":330630}
I20260807 13:39:06.396899 25297 raft_consensus.cc:482] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:39:06.437311 25297 raft_consensus.cc:504] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.438413 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:06.439780 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:06.440645 23470 raft_consensus.cc:2454] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
I20260807 13:39:06.442075 23470 raft_consensus.cc:1226] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3. Ops: []
I20260807 13:39:06.442777 23470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 485) took 1318 ms. Trace:
W20260807 13:39:06.445243 25514 log.cc:924] Time spent T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.141s user 0.000s sys 0.000s
I20260807 13:39:06.447860 23670 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b1542e790794928a76e4b29a1d7732b with delete_type TABLET_DATA_DELETED (Replaced by e2a4ce7bb4d64b8596158d5ac194e4a9 at 2026-08-07 13:39:00 UTC) from {username='slave'} at 127.0.0.1:57108
I20260807 13:39:06.449859 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:06.450723 23480 raft_consensus.cc:2454] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:39:06.450322 23670 tablet_service.cc:1467] Processing CreateTablet for tablet 0d7a01108a7042148334c054995cba3b (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260807 13:39:06.451043 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 633) took 1758 ms. Trace:
W20260807 13:39:06.451486 25494 log.cc:924] Time spent T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.211s user 0.000s sys 0.001s
I20260807 13:39:06.451843 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 486) took 1304 ms. Trace:
I20260807 13:39:06.452280 23480 rpcz_store.cc:276] 0807 13:39:05.147051 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.451326 (+1304275us) service_pool.cc:227] Handling call
0807 13:39:06.451765 (+ 439us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:06.451421 23481 rpcz_store.cc:276] 0807 13:39:04.693015 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:05.469421 (+776406us) service_pool.cc:227] Handling call
0807 13:39:05.469788 (+ 367us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:05.470228 (+ 440us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:05.470266 (+ 38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:05.470777 (+ 511us) log.cc:842] Serialized 26 byte log entry
0807 13:39:06.080296 (+609519us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:39:06.103168 (+ 22872us) log.cc:842] Serialized 14 byte log entry
0807 13:39:06.272935 (+169767us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b180026c500. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc69dfd68b1 00007fc69dfe3661 00007fc6950ae4ca 00007fc69e78ff99 00007fc694f72990 00007fc695134864 00007fc695134155 00007fc6980573d0 00007fc698069576 00007fc69807a0d7 00007fc69807a058
0807 13:39:06.273119 (+ 184us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:06.273190 (+ 71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:06.450734 (+177544us) raft_consensus.cc:1671] finished
0807 13:39:06.450848 (+ 114us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:06.450986 (+ 138us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4768,"prepare.queue_time_us":24477,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":172245,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":213,"spinlock_wait_cycles":9008384,"thread_start_us":609007,"threads_started":1,"wal-append.queue_time_us":721496}
I20260807 13:39:06.452840 23657 tablet_service.cc:1467] Processing CreateTablet for tablet 566a7784d04c469483a0a06b376eb089 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260807 13:39:06.454095 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 488) took 1286 ms. Trace:
I20260807 13:39:06.454301 23659 tablet_service.cc:1467] Processing CreateTablet for tablet 508c989e13ca4c47b5e2982478c5d328 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
W20260807 13:39:06.401063 25511 log.cc:924] Time spent T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.129s user 0.002s sys 0.000s
I20260807 13:39:06.404273 25498 raft_consensus.cc:504] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.454474 23481 rpcz_store.cc:276] 0807 13:39:05.167555 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.453371 (+1285816us) service_pool.cc:227] Handling call
0807 13:39:06.453626 (+ 255us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:06.453773 (+ 147us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:06.453805 (+ 32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:06.453846 (+ 41us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:06.453883 (+ 37us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:06.453944 (+ 61us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:06.454040 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:39:06.455379 25509 log.cc:924] Time spent T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.183s user 0.000s sys 0.001s
I20260807 13:39:06.333585 25410 leader_election.cc:288] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:06.428505 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:06.457266 23672 raft_consensus.cc:2454] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:39:06.396737 25291 raft_consensus.cc:504] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.453723 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 487) took 1302 ms. Trace:
I20260807 13:39:06.430856 25491 raft_consensus.cc:504] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.425439 23577 rpcz_store.cc:276] 0807 13:39:05.187892 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:05.420880 (+232988us) service_pool.cc:227] Handling call
0807 13:39:05.421249 (+ 369us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:06.100686 (+679437us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:06.424638 (+323952us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b540030cad4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:39:06.424899 (+ 261us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1552297728}
I20260807 13:39:06.428092 25287 raft_consensus.cc:504] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.436686 23567 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d7a01108a7042148334c054995cba3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:06.454360 23657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 566a7784d04c469483a0a06b376eb089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:06.456714 23481 raft_consensus.cc:1226] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 3. Current term is 4. Ops: []
I20260807 13:39:06.499002 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 489) took 1329 ms. Trace:
I20260807 13:39:06.499348 23481 rpcz_store.cc:276] 0807 13:39:05.169356 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.455626 (+1286270us) service_pool.cc:227] Handling call
0807 13:39:06.456562 (+ 936us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:06.498762 (+ 42200us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:06.498947 (+ 185us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:06.460263 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:06.267398 25322 consensus_queue.cc:260] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.470281 25291 leader_election.cc:288] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:06.429081 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d36f9c3051e24fba90a7a4418204d381" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:06.504549 23475 raft_consensus.cc:3037] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:06.195712 23455 tablet_service.cc:1467] Processing CreateTablet for tablet 566a7784d04c469483a0a06b376eb089 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260807 13:39:06.370472 25352 consensus_queue.cc:237] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.487246 25025 leader_election.cc:288] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:39:06.488252 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 185213us
I20260807 13:39:06.491972 23480 rpcz_store.cc:276] 0807 13:39:05.150934 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.452978 (+1302044us) service_pool.cc:227] Handling call
0807 13:39:06.453262 (+ 284us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:06.453421 (+ 159us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:06.453450 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:06.453488 (+ 38us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:06.453515 (+ 27us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:06.453563 (+ 48us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:06.453675 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:06.305332 23469 rpcz_store.cc:276] 0807 13:39:05.113665 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:05.534321 (+420656us) service_pool.cc:227] Handling call
0807 13:39:05.542982 (+ 8661us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:05.543181 (+ 199us) raft_consensus.cc:1520] Early marking committed up to index 1
0807 13:39:05.819860 (+276679us) log.cc:842] Serialized 14 byte log entry
0807 13:39:06.276543 (+456683us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:06.276638 (+ 95us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:06.276682 (+ 44us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:06.276760 (+ 78us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:06.276880 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":130111,"prepare.queue_time_us":335242,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":131062,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":14090,"thread_start_us":546744,"threads_started":2,"wal-append.queue_time_us":431160}
I20260807 13:39:06.497447 23672 raft_consensus.cc:3032] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:39:06.517719 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6646e8113874345a9835c8fce2e0c51" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:06.512090 23669 tablet_service.cc:1467] Processing CreateTablet for tablet e6d26fd195cb4bf4bd91ba45a72f87ac (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260807 13:39:06.504743 23429 leader_election.cc:302] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:06.519393 23669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6d26fd195cb4bf4bd91ba45a72f87ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:06.519634 23429 leader_election.cc:302] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:06.508957 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:06.517861 23672 raft_consensus.cc:729] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:06.522248 23672 consensus_queue.cc:260] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.523545 23672 raft_consensus.cc:3037] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:06.529771 23475 raft_consensus.cc:2454] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
I20260807 13:39:06.496472 25339 raft_consensus.cc:482] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:06.552502 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
W20260807 13:39:06.526328 23471 consensus_meta.cc:287] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.611s user 0.017s sys 0.003s
I20260807 13:39:06.503044 23346 catalog_manager.cc:5495] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 1 to 4, leader changed from 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2) to 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3). New cstate: current_term: 4 leader_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } }
I20260807 13:39:06.443184 23470 rpcz_store.cc:276] 0807 13:39:05.125346 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.441456 (+1316110us) service_pool.cc:227] Handling call
0807 13:39:06.441835 (+ 379us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:06.442499 (+ 664us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:06.442717 (+ 218us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:06.497264 25367 leader_election.cc:288] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:06.556807 25291 raft_consensus.cc:2781] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:39:06.576159 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:06.577299 23679 raft_consensus.cc:2396] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260807 13:39:06.494282 25326 raft_consensus.cc:504] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.582069 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:06.582011 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:06.582875 23475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 490) took 1390 ms. Trace:
I20260807 13:39:06.580295 23578 raft_consensus.cc:2454] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:39:06.588167 23475 rpcz_store.cc:276] 0807 13:39:05.192309 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.530888 (+1338579us) service_pool.cc:227] Handling call
0807 13:39:06.562352 (+ 31464us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b5800003398. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:39:06.582248 (+ 19896us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:06.582443 (+ 195us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:06.582469 (+ 26us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:06.582513 (+ 44us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:06.582557 (+ 44us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:06.582642 (+ 85us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:06.582794 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8816384}
I20260807 13:39:06.539314 25372 raft_consensus.cc:2781] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:39:06.588877 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:06.589463 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:06.593139 23581 raft_consensus.cc:1226] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3. Ops: []
I20260807 13:39:06.596628 23475 raft_consensus.cc:1226] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2. Ops: []
I20260807 13:39:06.597321 23475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 494) took 1300 ms. Trace:
I20260807 13:39:06.557104 25025 raft_consensus.cc:482] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:06.597697 23475 rpcz_store.cc:276] 0807 13:39:05.297315 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.592086 (+1294771us) service_pool.cc:227] Handling call
0807 13:39:06.592370 (+ 284us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:06.597051 (+ 4681us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:06.597237 (+ 186us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:06.602715 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:06.603332 23475 raft_consensus.cc:2454] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:39:06.603753 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:06.604852 23475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 495) took 1293 ms. Trace:
I20260807 13:39:06.605229 23475 rpcz_store.cc:276] 0807 13:39:05.311970 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.604060 (+1292090us) service_pool.cc:227] Handling call
0807 13:39:06.604351 (+ 291us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:06.604530 (+ 179us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:06.604569 (+ 39us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:06.604616 (+ 47us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:39:06.604647 (+ 31us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:06.604697 (+ 50us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:06.604801 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:06.600216 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:06.609652 23582 raft_consensus.cc:1226] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260807 13:39:06.570140 25492 leader_election.cc:288] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:06.532301 25445 consensus_queue.cc:1046] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260807 13:39:06.532474 25186 consensus_queue.cc:1046] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.057s
I20260807 13:39:06.607296 23475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 496) took 1232 ms. Trace:
I20260807 13:39:06.627770 23475 rpcz_store.cc:276] 0807 13:39:05.375229 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.606297 (+1231068us) service_pool.cc:227] Handling call
0807 13:39:06.606685 (+ 388us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:06.606899 (+ 214us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:06.606937 (+ 38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:06.606990 (+ 53us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:06.607033 (+ 43us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:06.607097 (+ 64us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:06.607228 (+ 131us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:06.595736 25372 raft_consensus.cc:482] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:06.586153 25291 raft_consensus.cc:482] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:06.564669 23471 raft_consensus.cc:2454] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 7.
I20260807 13:39:06.571384 23346 catalog_manager.cc:5495] T 3d67ad93011c4a87b0ede6554a1608ce P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:06.561380 25339 raft_consensus.cc:504] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.633911 23467 tablet_service.cc:1467] Processing CreateTablet for tablet 508c989e13ca4c47b5e2982478c5d328 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260807 13:39:06.597347 25367 consensus_queue.cc:1035] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.098s
I20260807 13:39:06.731940 23575 raft_consensus.cc:1226] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [term 5 LEADER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 4. Current term is 5. Ops: []
I20260807 13:39:06.734514 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 491) took 1537 ms. Trace:
I20260807 13:39:06.666867 23478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 638) took 1972 ms. Trace:
W20260807 13:39:06.733850 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 199140us
W20260807 13:39:06.676067 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 155326us
I20260807 13:39:06.682411 23532 leader_election.cc:302] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:06.611611 25311 raft_consensus.cc:482] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:06.612249 25265 leader_election.cc:288] T f4746a12996c4987a582df9f569b3c66 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:06.618554 25155 leader_election.cc:288] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:06.777145 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:06.737095 23478 rpcz_store.cc:276] 0807 13:39:04.694324 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:05.480886 (+786562us) service_pool.cc:227] Handling call
0807 13:39:05.481264 (+ 378us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:05.482263 (+ 999us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:39:06.143564 (+661301us) log.cc:842] Serialized 14 byte log entry
0807 13:39:06.388420 (+244856us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:06.389004 (+ 584us) log.cc:842] Serialized 26 byte log entry
0807 13:39:06.389152 (+ 148us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:39:06.402679 (+ 13527us) log.cc:842] Serialized 14 byte log entry
0807 13:39:06.408221 (+ 5542us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:06.408297 (+ 76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:06.666633 (+258336us) raft_consensus.cc:1671] finished
0807 13:39:06.666655 (+ 22us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:06.666804 (+ 149us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9955,"prepare.queue_time_us":409024,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":72,"raft.queue_time_us":14117,"raft.run_cpu_time_us":389,"raft.run_wall_time_us":2632,"thread_start_us":853096,"threads_started":2,"wal-append.queue_time_us":377856}
I20260807 13:39:06.617406 25498 leader_election.cc:288] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:06.745129 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6ae70649fa43bba8052b66977418f5" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:06.598354 25165 leader_election.cc:288] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:06.740767 25323 raft_consensus.cc:2726] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:39:06.748651 25361 raft_consensus.cc:3032] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 LEADER]: Stepping down as leader of term 3
W20260807 13:39:06.749087 23573 consensus_meta.cc:287] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.687s user 0.007s sys 0.007s
I20260807 13:39:06.672906 23566 tablet_service.cc:1467] Processing CreateTablet for tablet e6d26fd195cb4bf4bd91ba45a72f87ac (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260807 13:39:06.666078 25468 raft_consensus.cc:2229] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:39:06.736828 23481 rpcz_store.cc:276] 0807 13:39:05.196526 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.535583 (+1339057us) service_pool.cc:227] Handling call
0807 13:39:06.536035 (+ 452us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:06.536297 (+ 262us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:39:06.561258 (+ 24961us) log.cc:842] Serialized 14 byte log entry
0807 13:39:06.733192 (+171934us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:06.733333 (+ 141us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:06.733470 (+ 137us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:06.733618 (+ 148us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:06.734211 (+ 593us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15879,"prepare.queue_time_us":61823,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":22072,"thread_start_us":155482,"threads_started":1}
I20260807 13:39:06.788270 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:06.617090 23670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d7a01108a7042148334c054995cba3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:06.665870 23455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 566a7784d04c469483a0a06b376eb089. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 13:39:06.669767 25345 consensus_meta.cc:287] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 1.119s user 0.016s sys 0.007s
I20260807 13:39:06.741124 25304 raft_consensus.cc:482] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:06.775770 25302 raft_consensus.cc:482] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:06.773646 23346 catalog_manager.cc:5495] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 1 to 2, leader changed from 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2) to e11cad1eeaf5424c94e51241096f6613 (127.21.69.1). New cstate: current_term: 2 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: HEALTHY } } }
I20260807 13:39:06.808190 23346 catalog_manager.cc:5495] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 2 to 3, leader changed from 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2) to e11cad1eeaf5424c94e51241096f6613 (127.21.69.1). New cstate: current_term: 3 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:06.810348 23346 catalog_manager.cc:5495] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 2 to 3, leader changed from e11cad1eeaf5424c94e51241096f6613 (127.21.69.1) to 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3). New cstate: current_term: 3 leader_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } }
I20260807 13:39:06.778281 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:06.746912 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b078a19f38494b04ad11b14d98ec4bca" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:06.814002 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:06.626663 25490 leader_election.cc:288] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:06.732843 25291 raft_consensus.cc:3037] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:06.697114 24647 raft_consensus.cc:3032] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:39:06.780283 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:39:06.674460 25409 consensus_meta.cc:287] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.594s user 0.010s sys 0.010s
I20260807 13:39:06.781811 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:06.652822 25491 leader_election.cc:288] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:06.782539 23573 raft_consensus.cc:2454] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 6.
I20260807 13:39:06.785347 25526 raft_consensus.cc:482] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:06.792471 25377 raft_consensus.cc:482] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:06.771217 25522 tablet_replica.cc:330] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1: stopping tablet replica
I20260807 13:39:06.786196 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:06.695704 23559 tablet_service.cc:1467] Processing CreateTablet for tablet 508c989e13ca4c47b5e2982478c5d328 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260807 13:39:06.653980 25482 leader_election.cc:288] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:06.788599 23430 leader_election.cc:302] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
W20260807 13:39:06.786237 24805 consensus_meta.cc:287] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.720s user 0.010s sys 0.011s
I20260807 13:39:06.793218 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:06.617923 25297 leader_election.cc:288] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:06.778008 25372 raft_consensus.cc:3037] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:06.616314 25025 raft_consensus.cc:504] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.803066 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 493) took 1508 ms. Trace:
W20260807 13:39:06.773006 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 90721.1us
I20260807 13:39:06.778930 23471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 649) took 1215 ms. Trace:
I20260807 13:39:06.805783 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:06.613402 25357 raft_consensus.cc:482] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:06.783262 25361 raft_consensus.cc:729] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:06.814781 23478 raft_consensus.cc:2379] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:39:06.815089 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:06.815269 23479 raft_consensus.cc:1226] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [term 5 LEADER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 4. Current term is 5. Ops: []
I20260807 13:39:06.815814 23346 catalog_manager.cc:5495] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 3 to 4, leader changed from e11cad1eeaf5424c94e51241096f6613 (127.21.69.1) to 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3). New cstate: current_term: 4 leader_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } }
W20260807 13:39:06.818028 23631 consensus_peers.cc:487] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 5e0ea5aa0c6d4846a5ccc9962342e17a -> Peer e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037): Couldn't send request to peer e11cad1eeaf5424c94e51241096f6613. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:39:06.788625 25273 raft_consensus.cc:2781] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260807 13:39:06.804967 25359 consensus_meta.cc:287] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.535s user 0.016s sys 0.015s
I20260807 13:39:06.780244 25428 consensus_queue.cc:1035] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260807 13:39:06.757774 25311 raft_consensus.cc:504] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.785123 23560 tablet_service.cc:1467] Processing CreateTablet for tablet 566a7784d04c469483a0a06b376eb089 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260807 13:39:06.634567 23458 tablet_service.cc:1467] Processing CreateTablet for tablet e6d26fd195cb4bf4bd91ba45a72f87ac (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260807 13:39:06.806381 25524 raft_consensus.cc:482] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:06.782493 25186 consensus_queue.cc:1046] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260807 13:39:06.832412 23575 raft_consensus.cc:2454] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4.
I20260807 13:39:06.737803 25442 raft_consensus.cc:482] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:06.636328 23465 tablet_service.cc:1467] Processing CreateTablet for tablet dd8a99f8a43a4481a51b4d339f14bfdc (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260807 13:39:06.802951 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:06.837649 23676 raft_consensus.cc:1261] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 7 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260807 13:39:06.819480 25487 consensus_meta.cc:287] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.558s user 0.021s sys 0.000s
I20260807 13:39:06.812837 25287 leader_election.cc:288] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:06.805475 25345 raft_consensus.cc:504] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.817011 25302 raft_consensus.cc:504] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.812492 25304 raft_consensus.cc:504] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.817498 25471 raft_consensus.cc:2229] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Raft consensus shutting down.
W20260807 13:39:07.189041 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 410527us
I20260807 13:39:07.189314 23478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:06.872545 23562 tablet_service.cc:1467] Processing CreateTablet for tablet 46cd5d7fc0cd4f06aa175ad4406c7845 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260807 13:39:06.840878 25301 raft_consensus.cc:482] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:06.637912 23456 tablet_service.cc:1467] Processing CreateTablet for tablet 24d412bb0b294eeaabde57c850783dab (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260807 13:39:06.636204 23462 tablet_service.cc:1467] Processing CreateTablet for tablet 23e06eb23c7549ca833574823dc2f8a1 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260807 13:39:07.193077 23532 leader_election.cc:302] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:06.910400 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:06.839932 25377 raft_consensus.cc:504] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:06.976491 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 194278us
I20260807 13:39:07.213765 23532 leader_election.cc:302] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:06.966701 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:07.214123 23633 leader_election.cc:302] T 46e552e0aa3f4433858116fa31ee8458 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
W20260807 13:39:06.841794 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 53290.5us
I20260807 13:39:07.196319 23680 raft_consensus.cc:2454] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 5.
I20260807 13:39:07.190800 23480 rpcz_store.cc:276] 0807 13:39:05.294246 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.591818 (+1297572us) service_pool.cc:227] Handling call
0807 13:39:06.773509 (+181691us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:06.802662 (+ 29153us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:06.802697 (+ 35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:06.802741 (+ 44us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:39:06.802780 (+ 39us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:06.802844 (+ 64us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:06.803004 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":31422,"raft.queue_time_us":29669,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":11809,"spinlock_wait_cycles":1664256}
I20260807 13:39:07.215216 23532 leader_election.cc:302] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:07.215267 23430 leader_election.cc:302] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:06.819167 25468 raft_consensus.cc:2258] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:07.196811 23346 catalog_manager.cc:5495] T 9adcbc4da68046a08d0694c794088162 P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:07.222378 23571 raft_consensus.cc:2454] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
W20260807 13:39:07.223194 23407 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:39:07.226179 23563 tablet_service.cc:1467] Processing CreateTablet for tablet cea21e439be142e588f12ee16d5f71b1 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260807 13:39:07.227500 23564 tablet_service.cc:1467] Processing CreateTablet for tablet 2d4dd3ca60c94d7e891841088eb8f765 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260807 13:39:07.229352 25434 consensus_meta.cc:287] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.821s user 0.000s sys 0.017s
I20260807 13:39:07.229758 25434 raft_consensus.cc:504] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:07.232944 25025 leader_election.cc:288] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:39:07.187270 25525 log.cc:924] Time spent T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.346s user 0.001s sys 0.000s
W20260807 13:39:06.872334 25521 log.cc:924] Time spent T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.080s user 0.001s sys 0.000s
I20260807 13:39:07.188651 25339 leader_election.cc:288] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:07.235114 23532 leader_election.cc:302] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters:
W20260807 13:39:07.235473 23577 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s user 0.005s sys 0.010s
W20260807 13:39:07.251572 23577 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s user 0.006s sys 0.010s
I20260807 13:39:07.113086 23659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 508c989e13ca4c47b5e2982478c5d328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:06.824672 24647 raft_consensus.cc:729] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:07.239406 23572 raft_consensus.cc:1226] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 7 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 6. Current term is 7. Ops: []
W20260807 13:39:06.872028 25527 log.cc:924] Time spent T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.074s user 0.001s sys 0.000s
W20260807 13:39:06.883035 25514 log.cc:924] Time spent T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.058s user 0.000s sys 0.001s
I20260807 13:39:06.835105 25409 raft_consensus.cc:2726] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765) with higher term. Message: Invalid argument: T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for earlier term 3. Current term is 4.
I20260807 13:39:06.943758 23566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6d26fd195cb4bf4bd91ba45a72f87ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:06.873360 25522 raft_consensus.cc:2229] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:39:07.244654 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:07.244827 23684 raft_consensus.cc:1261] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:39:06.845741 25491 raft_consensus.cc:2726] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:39:07.246372 23480 raft_consensus.cc:1226] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 7 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 6. Current term is 7. Ops: [4.2-6.3]
I20260807 13:39:07.304225 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 498) took 1884 ms. Trace:
I20260807 13:39:07.304728 23684 raft_consensus.cc:3032] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:39:07.223580 23346 catalog_manager.cc:5495] T f7572ca9ba3b47978ecbc11a3ed09244 P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 3 to 4, leader changed from 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2) to e11cad1eeaf5424c94e51241096f6613 (127.21.69.1). New cstate: current_term: 4 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: HEALTHY } } }
I20260807 13:39:07.259209 25316 raft_consensus.cc:2781] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:39:07.235709 25301 raft_consensus.cc:504] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:07.246770 23430 leader_election.cc:302] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:06.942373 23472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 484) took 1827 ms. Trace:
I20260807 13:39:07.306965 23472 rpcz_store.cc:276] 0807 13:39:05.114887 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.296905 (+1182018us) service_pool.cc:227] Handling call
0807 13:39:06.494041 (+197136us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:06.510252 (+ 16211us) raft_consensus.cc:1520] Early marking committed up to index 3
0807 13:39:06.611858 (+101606us) log.cc:842] Serialized 14 byte log entry
0807 13:39:06.827048 (+215190us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:06.836167 (+ 9119us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:39:06.842914 (+ 6747us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:06.869233 (+ 26319us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:06.939097 (+ 69864us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":24181,"prepare.queue_time_us":74288,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":2995,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"thread_start_us":167417,"threads_started":1,"wal-append.queue_time_us":314226}
I20260807 13:39:07.244760 25482 raft_consensus.cc:2781] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:39:07.309002 24647 consensus_queue.cc:260] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:07.310334 23472 raft_consensus.cc:1226] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 5. Current term is 6. Ops: []
I20260807 13:39:07.311215 23472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 500) took 1883 ms. Trace:
I20260807 13:39:07.167291 25155 raft_consensus.cc:482] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:39:07.112643 25331 raft_consensus.cc:482] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:07.234360 25265 raft_consensus.cc:2781] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:39:07.233593 24805 raft_consensus.cc:2726] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:39:07.220657 25338 raft_consensus.cc:482] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:06.936908 25326 leader_election.cc:288] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:07.240957 25186 consensus_queue.cc:1225] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer e11cad1eeaf5424c94e51241096f6613 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260807 13:39:07.238823 25492 raft_consensus.cc:482] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:07.258101 25287 consensus_queue.cc:1035] T a08c7e6c1b31456ea804d5ecdf2a5b70 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.099s
I20260807 13:39:07.355945 25492 raft_consensus.cc:504] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:07.341835 25471 raft_consensus.cc:2258] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:07.356928 25338 raft_consensus.cc:504] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:07.358246 25492 leader_election.cc:288] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:07.358922 25338 leader_election.cc:288] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:07.359539 25304 leader_election.cc:288] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:07.359869 25025 raft_consensus.cc:482] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:07.360147 25522 raft_consensus.cc:2258] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:07.360373 25025 raft_consensus.cc:504] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:07.362571 25025 leader_election.cc:288] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:07.363355 25522 ts_tablet_manager.cc:1905] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 13:39:07.302179 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:07.305168 23684 raft_consensus.cc:729] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:07.388402 23676 raft_consensus.cc:2454] T 622dda6b9b914746953c43538b53bb7e P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 7.
I20260807 13:39:07.189043 25273 raft_consensus.cc:482] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:07.311607 24647 raft_consensus.cc:3037] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:39:07.312146 25301 leader_election.cc:288] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:39:07.312211 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 70182.3us
I20260807 13:39:07.313206 23578 raft_consensus.cc:2454] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4.
I20260807 13:39:07.304675 23480 rpcz_store.cc:276] 0807 13:39:05.419893 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.215364 (+1795471us) service_pool.cc:227] Handling call
0807 13:39:07.246100 (+ 30736us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:39:07.303862 (+ 57762us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:07.304152 (+ 290us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:07.188891 23471 rpcz_store.cc:276] 0807 13:39:05.558543 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:05.890224 (+331681us) service_pool.cc:227] Handling call
0807 13:39:06.750800 (+860576us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:39:07.316984 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 70290.4us
I20260807 13:39:07.195253 25361 consensus_queue.cc:260] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:07.255126 25498 raft_consensus.cc:2781] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:39:07.251040 25352 raft_consensus.cc:482] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:07.255556 25487 raft_consensus.cc:482] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:07.220292 25357 raft_consensus.cc:504] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:06.839064 25526 raft_consensus.cc:504] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:07.298445 25434 leader_election.cc:288] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:07.348233 25155 raft_consensus.cc:504] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:07.366214 25491 raft_consensus.cc:482] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:07.366359 25326 raft_consensus.cc:2726] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:39:07.366631 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9fcdd060ef64874a8719c95b2325942" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:07.367370 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:07.237260 25442 raft_consensus.cc:504] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:07.338932 25482 raft_consensus.cc:686] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 4 LEADER]: Becoming Leader. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:39:07.396796 25306 raft_consensus.cc:482] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:07.372491 25302 leader_election.cc:288] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:07.373523 25345 leader_election.cc:288] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 7 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:07.396565 25301 raft_consensus.cc:482] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:39:07.315634 25339 raft_consensus.cc:482] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:06.880788 23570 tablet_service.cc:1467] Processing CreateTablet for tablet 23e06eb23c7549ca833574823dc2f8a1 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260807 13:39:07.382647 25400 consensus_meta.cc:287] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.971s user 0.010s sys 0.002s
I20260807 13:39:07.237841 25524 raft_consensus.cc:504] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:07.385039 25377 leader_election.cc:288] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:07.245790 25403 consensus_queue.cc:1046] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.090s
I20260807 13:39:07.244000 25490 raft_consensus.cc:482] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:39:07.386829 25537 log.cc:924] Time spent T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.272s user 0.000s sys 0.001s
I20260807 13:39:07.353324 25265 raft_consensus.cc:482] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:07.403625 25352 raft_consensus.cc:504] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:07.388757 23684 consensus_queue.cc:260] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:07.390563 25273 raft_consensus.cc:3037] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:07.352757 25331 raft_consensus.cc:504] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:07.298488 25297 consensus_queue.cc:1046] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.129s
I20260807 13:39:07.365207 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:07.398077 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9fcdd060ef64874a8719c95b2325942" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:39:07.401800 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 139725us
I20260807 13:39:07.366226 23675 raft_consensus.cc:1226] T bc264e3efe7340e4a63da01f78c1f136 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 4. Current term is 5. Ops: []
I20260807 13:39:07.369153 25468 ts_tablet_manager.cc:1905] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 13:39:07.396590 25498 raft_consensus.cc:482] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:07.394026 25445 consensus_queue.cc:1046] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260807 13:39:07.312940 23346 catalog_manager.cc:5495] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 1 to 3, leader changed from 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2) to 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3). New cstate: current_term: 3 leader_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } }
I20260807 13:39:07.397799 23429 leader_election.cc:302] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:07.394665 23430 leader_election.cc:302] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
@ 0x7fc695327d50 testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
I20260807 13:39:07.332231 23472 rpcz_store.cc:276] 0807 13:39:05.427754 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.309596 (+1881842us) service_pool.cc:227] Handling call
0807 13:39:07.310060 (+ 464us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:07.310881 (+ 821us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:07.311142 (+ 261us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:07.365280 23473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 482) took 2251 ms. Trace:
I20260807 13:39:07.403939 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 497) took 2007 ms. Trace:
I20260807 13:39:07.536283 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:07.535044 23481 rpcz_store.cc:276] 0807 13:39:05.396922 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.792735 (+1395813us) service_pool.cc:227] Handling call
0807 13:39:06.793179 (+ 444us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:06.793391 (+ 212us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:39:06.820105 (+ 26714us) log.cc:842] Serialized 14 byte log entry
0807 13:39:07.403150 (+583045us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:07.403202 (+ 52us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:07.403254 (+ 52us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:07.403531 (+ 277us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:07.403817 (+ 286us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11702,"prepare.queue_time_us":19876,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":4814,"raft.queue_time_us":73079,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":21781,"thread_start_us":570866,"threads_started":2,"wal-append.queue_time_us":585261}
I20260807 13:39:07.537954 23475 raft_consensus.cc:2454] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
I20260807 13:39:07.502162 23465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd8a99f8a43a4481a51b4d339f14bfdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:07.540062 23475 raft_consensus.cc:1226] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 4. Current term is 5. Ops: []
I20260807 13:39:07.540952 23475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 505) took 1994 ms. Trace:
I20260807 13:39:07.541092 23479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 476) took 2428 ms. Trace:
I20260807 13:39:07.541339 23475 rpcz_store.cc:276] 0807 13:39:05.546490 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.539182 (+1992692us) service_pool.cc:227] Handling call
0807 13:39:07.539739 (+ 557us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:07.540635 (+ 896us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:07.540886 (+ 251us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:07.541481 23479 rpcz_store.cc:276] 0807 13:39:05.112456 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:05.529229 (+416773us) service_pool.cc:227] Handling call
0807 13:39:05.555021 (+ 25792us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:07.212301 (+1657280us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:07.540645 (+328344us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54001af754. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:39:07.540910 (+ 265us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2897740672}
I20260807 13:39:07.543310 23475 raft_consensus.cc:1226] T 608f7e63bc4648e0890e5f601c52736c P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 13:39:07.519023 23471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 502) took 2028 ms. Trace:
I20260807 13:39:07.544129 23475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 506) took 1997 ms. Trace:
I20260807 13:39:07.544546 23475 rpcz_store.cc:276] 0807 13:39:05.546870 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.542345 (+1995475us) service_pool.cc:227] Handling call
0807 13:39:07.542899 (+ 554us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:07.543823 (+ 924us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:07.544072 (+ 249us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:07.539459 23481 raft_consensus.cc:1226] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 4. Current term is 5. Ops: []
I20260807 13:39:07.546272 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 504) took 2011 ms. Trace:
I20260807 13:39:07.533665 23473 rpcz_store.cc:276] 0807 13:39:05.114260 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.259009 (+1144749us) service_pool.cc:227] Handling call
0807 13:39:06.259359 (+ 350us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:06.321266 (+ 61907us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:06.321309 (+ 43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:06.333651 (+ 12342us) log.cc:842] Serialized 26 byte log entry
0807 13:39:06.602531 (+268880us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:39:06.602572 (+ 41us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:06.602650 (+ 78us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:07.365078 (+762428us) raft_consensus.cc:1671] finished
0807 13:39:07.365097 (+ 19us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:07.365220 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":61467,"raft.queue_time_us":72765,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":112,"thread_start_us":267791,"threads_started":1,"wal-append.queue_time_us":404535}
I20260807 13:39:07.546840 23481 rpcz_store.cc:276] 0807 13:39:05.535060 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.538388 (+2003328us) service_pool.cc:227] Handling call
0807 13:39:07.539070 (+ 682us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:07.545866 (+ 6796us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:07.546166 (+ 300us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:07.481962 23346 catalog_manager.cc:5495] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 2 to 5, leader changed from 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2) to e11cad1eeaf5424c94e51241096f6613 (127.21.69.1). New cstate: current_term: 5 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:07.549078 23473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 647) took 1991 ms. Trace:
W20260807 13:39:07.488960 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 91046.9us
W20260807 13:39:07.493641 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 97019.6us
I20260807 13:39:07.549583 23473 rpcz_store.cc:276] 0807 13:39:05.558102 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.547784 (+1989682us) service_pool.cc:227] Handling call
0807 13:39:07.548338 (+ 554us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:07.548700 (+ 362us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:07.548725 (+ 25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:07.548788 (+ 63us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:07.548835 (+ 47us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:07.548905 (+ 70us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:07.549019 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:07.551302 23430 leader_election.cc:302] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:07.544312 23471 rpcz_store.cc:276] 0807 13:39:05.490059 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.517235 (+2027176us) service_pool.cc:227] Handling call
0807 13:39:07.517956 (+ 721us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:07.518329 (+ 373us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:07.518378 (+ 49us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:07.518439 (+ 61us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:07.518487 (+ 48us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:07.518581 (+ 94us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:07.518748 (+ 167us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:07.552234 23458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6d26fd195cb4bf4bd91ba45a72f87ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:07.553682 23471 raft_consensus.cc:1261] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 7 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260807 13:39:07.553797 23430 leader_election.cc:302] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:07.545177 23478 raft_consensus.cc:1261] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260807 13:39:07.555352 23478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 499) took 2128 ms. Trace:
I20260807 13:39:07.555835 23478 rpcz_store.cc:276] 0807 13:39:05.427325 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.221535 (+1794210us) service_pool.cc:227] Handling call
0807 13:39:07.544262 (+322727us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b5800003398. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:39:07.544518 (+ 256us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:07.554956 (+ 10438us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:07.555234 (+ 278us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":32557824}
I20260807 13:39:07.554171 23471 pending_rounds.cc:76] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613: Aborting all ops after (but not including) 3
I20260807 13:39:07.557374 23471 pending_rounds.cc:97] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260807 13:39:07.557821 23471 raft_consensus.cc:2866] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:39:07.557925 23478 raft_consensus.cc:1226] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3. Ops: []
I20260807 13:39:07.558712 23478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 507) took 1638 ms. Trace:
I20260807 13:39:07.558812 23471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 651) took 1999 ms. Trace:
I20260807 13:39:07.556445 23467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 508c989e13ca4c47b5e2982478c5d328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:07.543505 23479 raft_consensus.cc:1203] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[2.1-6.3] Dedup: 2.1->[4.2-6.3]
I20260807 13:39:07.532665 23472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 503) took 2042 ms. Trace:
I20260807 13:39:07.560288 23479 pending_rounds.cc:76] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613: Aborting all ops after (but not including) 1
I20260807 13:39:07.560732 23479 pending_rounds.cc:97] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613: Aborting uncommitted NO_OP operation due to leader change: 5.2
I20260807 13:39:07.561058 23479 raft_consensus.cc:2866] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:39:07.560369 23472 rpcz_store.cc:276] 0807 13:39:05.490432 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.530907 (+2040475us) service_pool.cc:227] Handling call
0807 13:39:07.531527 (+ 620us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:07.532007 (+ 480us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:07.532049 (+ 42us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:07.532154 (+ 105us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:07.532204 (+ 50us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:07.532283 (+ 79us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:07.532455 (+ 172us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:07.552245 23473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 650) took 1993 ms. Trace:
I20260807 13:39:07.559571 23346 catalog_manager.cc:5495] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 1 to 4, leader changed from 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2) to 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3). New cstate: current_term: 4 leader_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } }
I20260807 13:39:07.559152 23478 rpcz_store.cc:276] 0807 13:39:05.920727 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.557133 (+1636406us) service_pool.cc:227] Handling call
0807 13:39:07.557613 (+ 480us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:07.558376 (+ 763us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:07.558652 (+ 276us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:39:07.565730 23532 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.21.69.1:45037 timed out after 1.779s (SENT) [suppressed 17 similar messages]
I20260807 13:39:07.564287 23346 catalog_manager.cc:5495] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: HEALTHY } } }
I20260807 13:39:06.908041 23561 tablet_service.cc:1467] Processing CreateTablet for tablet dd8a99f8a43a4481a51b4d339f14bfdc (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260807 13:39:07.369336 23533 leader_election.cc:302] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
W20260807 13:39:07.570613 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 201157us
I20260807 13:39:07.569581 23346 catalog_manager.cc:5495] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 3 to 4, leader changed from 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2) to e11cad1eeaf5424c94e51241096f6613 (127.21.69.1). New cstate: current_term: 4 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: UNKNOWN } } }
I20260807 13:39:07.579561 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4996c3c52ccc41b9a8da11ca747a8e6a" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:07.580619 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:07.582198 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d96e350af14393a80eeb2702230747" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:07.380755 23565 tablet_service.cc:1467] Processing CreateTablet for tablet 24d412bb0b294eeaabde57c850783dab (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260807 13:39:07.418084 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 176266us
I20260807 13:39:07.602771 23559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 508c989e13ca4c47b5e2982478c5d328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:07.617057 23533 leader_election.cc:302] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:07.604072 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6ae70649fa43bba8052b66977418f5" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:07.559243 23471 rpcz_store.cc:276] 0807 13:39:05.558890 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.552528 (+1993638us) service_pool.cc:227] Handling call
0807 13:39:07.553053 (+ 525us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:07.558567 (+ 5514us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:07.558753 (+ 186us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:07.587623 23571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 524) took 1340 ms. Trace:
I20260807 13:39:07.605535 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:07.588843 23572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 505) took 2136 ms. Trace:
I20260807 13:39:07.563323 23473 rpcz_store.cc:276] 0807 13:39:05.558723 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.550979 (+1992256us) service_pool.cc:227] Handling call
0807 13:39:07.551483 (+ 504us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:07.552022 (+ 539us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:07.552187 (+ 165us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:07.422488 23664 tablet_service.cc:1467] Processing CreateTablet for tablet dd8a99f8a43a4481a51b4d339f14bfdc (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260807 13:39:07.590339 23578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 516) took 1008 ms. Trace:
I20260807 13:39:07.596774 23633 leader_election.cc:302] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:07.591364 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b078a19f38494b04ad11b14d98ec4bca" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:07.594077 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:07.564286 23456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24d412bb0b294eeaabde57c850783dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:07.641827 23572 rpcz_store.cc:276] 0807 13:39:05.452555 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:05.608748 (+156193us) service_pool.cc:227] Handling call
0807 13:39:05.635857 (+ 27109us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:07.254670 (+1618813us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:07.588255 (+333585us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b540030c0d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:39:07.588618 (+ 363us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3687374720}
I20260807 13:39:07.585539 23346 catalog_manager.cc:5495] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 1 to 2, leader changed from e11cad1eeaf5424c94e51241096f6613 (127.21.69.1) to 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3). New cstate: current_term: 2 leader_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } }
I20260807 13:39:07.649302 23578 rpcz_store.cc:276] 0807 13:39:06.582174 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.588614 (+ 6440us) service_pool.cc:227] Handling call
0807 13:39:07.589899 (+1001285us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b540020d0d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:39:07.590114 (+ 215us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1644313344}
I20260807 13:39:07.626349 23571 rpcz_store.cc:276] 0807 13:39:06.246897 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.247035 (+ 138us) service_pool.cc:227] Handling call
0807 13:39:07.587184 (+1340149us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b540024efd4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:39:07.587367 (+ 183us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2108359040}
I20260807 13:39:07.424014 23684 raft_consensus.cc:3037] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:07.434688 25498 raft_consensus.cc:3037] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:07.725016 23575 raft_consensus.cc:2454] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:39:07.420502 25265 raft_consensus.cc:3037] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:07.774055 23582 raft_consensus.cc:2454] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 6.
I20260807 13:39:07.783396 23575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 534) took 1041 ms. Trace:
I20260807 13:39:07.790331 23565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24d412bb0b294eeaabde57c850783dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:07.788697 23574 raft_consensus.cc:2454] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:39:07.789326 23575 rpcz_store.cc:276] 0807 13:39:06.741665 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.238268 (+496603us) service_pool.cc:227] Handling call
0807 13:39:07.603732 (+365464us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ffb7c 00007fc6950ff73b 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:39:07.783291 (+179559us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2625792}
I20260807 13:39:07.592484 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:07.787258 23582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 520) took 1148 ms. Trace:
I20260807 13:39:07.793321 23582 rpcz_store.cc:276] 0807 13:39:06.638517 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.771961 (+133444us) service_pool.cc:227] Handling call
0807 13:39:07.580065 (+808104us) spinlock_profiling.cc:243] Waited 5.77 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:39:07.787166 (+207101us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":13263616}
I20260807 13:39:07.437418 25322 raft_consensus.cc:3037] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:39:07.418108 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "356c6b3e51454d418acaa9be70bb9689" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:07.408164 25361 raft_consensus.cc:3037] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:39:07.436057 25291 consensus_meta.cc:287] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.602s user 0.000s sys 0.009s
I20260807 13:39:07.441939 25540 raft_consensus.cc:3032] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:39:07.428369 25316 raft_consensus.cc:482] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:07.441079 25554 raft_consensus.cc:3032] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:39:07.406178 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:07.794922 23574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 536) took 1050 ms. Trace:
I20260807 13:39:07.804656 23471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 513) took 1762 ms. Trace:
I20260807 13:39:07.806186 23664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd8a99f8a43a4481a51b4d339f14bfdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:07.420339 25155 leader_election.cc:288] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:07.806420 25302 raft_consensus.cc:2726] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:39:07.807529 25540 raft_consensus.cc:729] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:07.428238 23662 tablet_service.cc:1467] Processing CreateTablet for tablet 24d412bb0b294eeaabde57c850783dab (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260807 13:39:07.442075 25526 leader_election.cc:288] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:07.424957 25352 leader_election.cc:288] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:07.807852 25291 raft_consensus.cc:504] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:07.808296 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 191681us
I20260807 13:39:07.808538 25492 raft_consensus.cc:2726] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:39:07.430723 25372 raft_consensus.cc:504] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:07.808436 23661 tablet_service.cc:1467] Processing CreateTablet for tablet 46cd5d7fc0cd4f06aa175ad4406c7845 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260807 13:39:07.416505 25339 raft_consensus.cc:504] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:07.404627 25487 raft_consensus.cc:504] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:07.809633 25551 raft_consensus.cc:482] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:07.810304 23346 catalog_manager.cc:5495] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 1 to 2, leader changed from 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2) to e11cad1eeaf5424c94e51241096f6613 (127.21.69.1). New cstate: current_term: 2 leader_uuid: "e11cad1eeaf5424c94e51241096f6613" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } health_report { overall_health: HEALTHY } } }
I20260807 13:39:07.790526 25165 raft_consensus.cc:2781] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:39:07.799201 23581 raft_consensus.cc:2454] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
W20260807 13:39:07.800753 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 235266us
I20260807 13:39:07.423153 25357 leader_election.cc:288] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:07.429880 25311 leader_election.cc:288] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:07.816322 23471 rpcz_store.cc:276] 0807 13:39:06.038005 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.622300 (+1584295us) service_pool.cc:227] Handling call
0807 13:39:07.739387 (+117087us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:07.791916 (+ 52529us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:07.791952 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:07.796412 (+ 4460us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:39:07.800267 (+ 3855us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:07.800319 (+ 52us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:07.800475 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:39:07.806059 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 123467us
I20260807 13:39:07.824747 23577 raft_consensus.cc:2379] T 11eba6f59d7f4541873d69ef88a0ad93 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 5: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:39:07.416105 25301 raft_consensus.cc:504] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:07.833515 25557 raft_consensus.cc:482] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:39:07.835021 23462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23e06eb23c7549ca833574823dc2f8a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:07.429334 25442 leader_election.cc:288] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:07.429306 25331 leader_election.cc:288] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:07.427181 25482 consensus_queue.cc:237] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:07.815729 23574 rpcz_store.cc:276] 0807 13:39:06.742222 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.581714 (+839492us) service_pool.cc:227] Handling call
0807 13:39:07.792085 (+210371us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:07.930691 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:07.931331 25338 raft_consensus.cc:482] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:07.931922 23574 raft_consensus.cc:1226] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2. Ops: []
I20260807 13:39:07.422068 25524 leader_election.cc:288] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:07.932106 25338 raft_consensus.cc:504] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:07.932691 23578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 522) took 1200 ms. Trace:
I20260807 13:39:07.932577 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:07.423604 23663 tablet_service.cc:1467] Processing CreateTablet for tablet 23e06eb23c7549ca833574823dc2f8a1 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260807 13:39:07.933187 23578 rpcz_store.cc:276] 0807 13:39:06.732299 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.824636 (+1092337us) service_pool.cc:227] Handling call
0807 13:39:07.932034 (+107398us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:07.932340 (+ 306us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:07.932364 (+ 24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:07.932432 (+ 68us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:07.932459 (+ 27us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:07.932523 (+ 64us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:07.932633 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:07.934159 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:07.442458 25471 ts_tablet_manager.cc:1905] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 13:39:07.935760 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:07.937031 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:07.938623 25155 raft_consensus.cc:482] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:39:07.859087 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 298095us
I20260807 13:39:07.864957 23571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 519) took 1226 ms. Trace:
I20260807 13:39:07.806110 25345 raft_consensus.cc:2726] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:39:07.860222 23573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 531) took 1064 ms. Trace:
I20260807 13:39:07.414242 25306 raft_consensus.cc:504] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:07.860013 25287 raft_consensus.cc:2781] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:39:07.911509 23676 raft_consensus.cc:2454] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 5.
I20260807 13:39:07.870270 25165 raft_consensus.cc:482] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:07.912292 23680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57122 (request call id 561) took 1060 ms. Trace:
I20260807 13:39:07.866768 25302 raft_consensus.cc:482] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:07.912818 23668 tablet_service.cc:1467] Processing CreateTablet for tablet 2d4dd3ca60c94d7e891841088eb8f765 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260807 13:39:07.917829 23582 raft_consensus.cc:1226] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 [term 5 LEADER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 4. Current term is 5. Ops: []
I20260807 13:39:07.918530 23581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 538) took 1174 ms. Trace:
I20260807 13:39:07.411996 25491 raft_consensus.cc:504] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:07.852612 23473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 515) took 1749 ms. Trace:
I20260807 13:39:07.896251 23577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 539) took 1153 ms. Trace:
I20260807 13:39:07.921149 24931 raft_consensus.cc:2726] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:07.807209 25186 consensus_queue.cc:1046] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.110s
I20260807 13:39:07.911890 23562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46cd5d7fc0cd4f06aa175ad4406c7845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:07.976346 23582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 521) took 1325 ms. Trace:
I20260807 13:39:07.976996 23582 rpcz_store.cc:276] 0807 13:39:06.645979 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.837525 (+1191546us) service_pool.cc:227] Handling call
0807 13:39:07.874557 (+ 37032us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:07.963869 (+ 89312us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:07.964184 (+ 315us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:07.960034 23577 rpcz_store.cc:276] 0807 13:39:06.742949 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.392354 (+649405us) service_pool.cc:227] Handling call
0807 13:39:07.593709 (+201355us) spinlock_profiling.cc:243] Waited 9.09 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ffb7c 00007fc6950ff73b 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:39:07.896174 (+302465us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":20908288}
I20260807 13:39:07.932624 23574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 523) took 1188 ms. Trace:
I20260807 13:39:07.979625 23574 rpcz_store.cc:276] 0807 13:39:06.743748 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.931171 (+1187423us) service_pool.cc:227] Handling call
0807 13:39:07.931670 (+ 499us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:07.932356 (+ 686us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:07.932548 (+ 192us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:07.421365 23665 tablet_service.cc:1467] Processing CreateTablet for tablet cea21e439be142e588f12ee16d5f71b1 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260807 13:39:07.946169 23578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 524) took 1196 ms. Trace:
I20260807 13:39:07.939440 23571 rpcz_store.cc:276] 0807 13:39:06.638158 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.826478 (+1188320us) service_pool.cc:227] Handling call
0807 13:39:07.864164 (+ 37686us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:07.864542 (+ 378us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:07.864569 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:07.864629 (+ 60us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:07.864657 (+ 28us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:07.864717 (+ 60us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:07.864855 (+ 138us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:07.934151 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6ae70649fa43bba8052b66977418f5" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:39:07.960330 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 45178.7us
I20260807 13:39:07.960965 23473 rpcz_store.cc:276] 0807 13:39:06.103719 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.669950 (+1566231us) service_pool.cc:227] Handling call
0807 13:39:07.783042 (+113092us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:07.841657 (+ 58615us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:07.841683 (+ 26us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:07.845689 (+ 4006us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:07.852255 (+ 6566us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:07.852352 (+ 97us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:07.852528 (+ 176us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:07.967065 23478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 511) took 2002 ms. Trace:
I20260807 13:39:07.808346 25297 consensus_queue.cc:1046] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.133s
I20260807 13:39:07.964303 23581 rpcz_store.cc:276] 0807 13:39:06.742710 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.120756 (+378046us) service_pool.cc:227] Handling call
0807 13:39:07.590945 (+470189us) spinlock_profiling.cc:243] Waited 8.55 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:39:07.916986 (+326041us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":19665152}
I20260807 13:39:07.420758 25490 raft_consensus.cc:504] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:07.945744 23680 rpcz_store.cc:276] 0807 13:39:06.781402 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.781580 (+ 178us) service_pool.cc:227] Handling call
0807 13:39:07.812088 (+1030508us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54003462d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:39:07.842108 (+ 30020us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":842073984}
I20260807 13:39:07.981185 23578 rpcz_store.cc:276] 0807 13:39:06.744116 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.934349 (+1190233us) service_pool.cc:227] Handling call
0807 13:39:07.935039 (+ 690us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:07.935422 (+ 383us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:07.935456 (+ 34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:07.935503 (+ 47us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:07.935541 (+ 38us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:07.935597 (+ 56us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:07.940774 (+ 5177us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:08.011885 23470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 492) took 2720 ms. Trace:
I20260807 13:39:07.943084 25287 raft_consensus.cc:482] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:07.982141 23478 rpcz_store.cc:276] 0807 13:39:06.015223 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.564442 (+1549219us) service_pool.cc:227] Handling call
0807 13:39:07.584511 (+ 20069us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:07.585035 (+ 524us) raft_consensus.cc:1520] Early marking committed up to index 3
0807 13:39:07.736567 (+151532us) log.cc:842] Serialized 14 byte log entry
0807 13:39:07.944799 (+208232us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:07.944863 (+ 64us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:39:07.966649 (+ 21786us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:07.966775 (+ 126us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:07.966977 (+ 202us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":151478,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":91,"thread_start_us":358559,"threads_started":2}
I20260807 13:39:07.959074 25165 raft_consensus.cc:3037] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 7 FOLLOWER]: Advancing to term 8
W20260807 13:39:08.053095 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 125004us
I20260807 13:39:08.054811 25301 leader_election.cc:288] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:08.053158 23469 raft_consensus.cc:2379] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 5: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:39:08.059576 23430 leader_election.cc:302] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:08.061719 25442 raft_consensus.cc:482] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:08.062664 25442 raft_consensus.cc:504] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:08.064761 23473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 518) took 1567 ms. Trace:
I20260807 13:39:08.065188 23473 rpcz_store.cc:276] 0807 13:39:06.497620 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:08.016662 (+1519042us) service_pool.cc:227] Handling call
0807 13:39:08.064074 (+ 47412us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:08.064339 (+ 265us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:08.064370 (+ 31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:08.064443 (+ 73us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:08.064475 (+ 32us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:08.064533 (+ 58us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:08.064668 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:08.067849 23480 raft_consensus.cc:1226] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 3. Current term is 4. Ops: []
I20260807 13:39:08.033102 25287 raft_consensus.cc:3037] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:08.036921 25554 raft_consensus.cc:729] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:08.012436 23470 rpcz_store.cc:276] 0807 13:39:05.291005 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.591626 (+1300621us) service_pool.cc:227] Handling call
0807 13:39:07.498634 (+907008us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b5800003398. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ffbce 000000000034aea9 00007fc69cf2ba30 00007fc69cff17b4 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:39:07.499211 (+ 577us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:07.505968 (+ 6757us) raft_consensus.cc:1520] Early marking committed up to index 3
0807 13:39:07.507079 (+ 1111us) log.cc:842] Serialized 14 byte log entry
0807 13:39:08.010709 (+503630us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:08.010789 (+ 80us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:39:08.010833 (+ 44us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:08.010909 (+ 76us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:08.011092 (+ 183us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":110154,"prepare.queue_time_us":136189,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":190946,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":170,"spinlock_wait_cycles":65513216,"thread_start_us":367668,"threads_started":2,"wal-append.queue_time_us":226959}
I20260807 13:39:08.068998 23346 catalog_manager.cc:5495] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } }
I20260807 13:39:07.943436 23573 rpcz_store.cc:276] 0807 13:39:06.795898 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.845541 (+ 49643us) service_pool.cc:227] Handling call
0807 13:39:07.592086 (+746545us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:39:07.858086 (+266000us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":32255872}
I20260807 13:39:08.067353 23473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 520) took 1569 ms. Trace:
I20260807 13:39:08.082198 23473 rpcz_store.cc:276] 0807 13:39:06.498136 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:08.066261 (+1568125us) service_pool.cc:227] Handling call
0807 13:39:08.066736 (+ 475us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:08.066993 (+ 257us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:08.067022 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:08.067080 (+ 58us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:08.067113 (+ 33us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:08.067166 (+ 53us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:08.067291 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:07.912830 25316 raft_consensus.cc:3037] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:08.088475 25338 leader_election.cc:288] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:39:08.090927 23669 consensus_meta.cc:287] T e6d26fd195cb4bf4bd91ba45a72f87ac P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.865s user 0.008s sys 0.008s
I20260807 13:39:08.091846 25571 consensus_queue.cc:1046] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.052s
I20260807 13:39:08.075140 25491 leader_election.cc:288] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:39:08.115108 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 518712us
I20260807 13:39:08.118098 25311 raft_consensus.cc:482] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:08.118501 25291 leader_election.cc:288] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:08.118753 23567 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49032 (request call id 76) took 1821 ms. Trace:
I20260807 13:39:08.118872 25311 raft_consensus.cc:504] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:08.119377 23567 rpcz_store.cc:276] 0807 13:39:06.284118 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.304029 (+ 19911us) service_pool.cc:227] Handling call
0807 13:39:06.435753 (+131724us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:06.435916 (+ 163us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:07.229969 (+794053us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:07.581943 (+351974us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:08.077738 (+495795us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":391207,"threads_started":1}
I20260807 13:39:08.122001 25311 leader_election.cc:288] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:08.123769 23581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 530) took 1328 ms. Trace:
I20260807 13:39:08.124207 23581 rpcz_store.cc:276] 0807 13:39:06.795482 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:08.024694 (+1229212us) service_pool.cc:227] Handling call
0807 13:39:08.098349 (+ 73655us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:08.119332 (+ 20983us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:08.119359 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:08.119407 (+ 48us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:08.119436 (+ 29us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:08.119503 (+ 67us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:08.119631 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:08.118189 25339 leader_election.cc:288] T 448ac0b9f0f0494cbeb234299ad5cc22 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:08.024705 25155 raft_consensus.cc:504] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:07.917830 25551 raft_consensus.cc:504] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:08.068176 25540 consensus_queue.cc:260] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:07.984246 25557 raft_consensus.cc:504] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:08.142402 23475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 645) took 2573 ms. Trace:
I20260807 13:39:08.050598 25302 raft_consensus.cc:504] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:08.141588 25565 raft_consensus.cc:482] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:08.115672 23346 catalog_manager.cc:5495] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9ae273efd33642ad970ab8d1973917c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } }
I20260807 13:39:08.150244 23577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 540) took 1390 ms. Trace:
I20260807 13:39:08.152652 23577 rpcz_store.cc:276] 0807 13:39:06.760121 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.999116 (+1238995us) service_pool.cc:227] Handling call
0807 13:39:08.059670 (+ 60554us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:08.128023 (+ 68353us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:08.128068 (+ 45us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:08.128138 (+ 70us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:39:08.149868 (+ 21730us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:08.149974 (+ 106us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:08.150158 (+ 184us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1502464}
I20260807 13:39:08.147120 25409 raft_consensus.cc:482] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:08.158447 25409 raft_consensus.cc:504] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:08.158597 25554 consensus_queue.cc:260] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:08.159329 23470 raft_consensus.cc:1226] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 3. Current term is 4. Ops: []
I20260807 13:39:08.160305 23470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 521) took 1661 ms. Trace:
I20260807 13:39:08.160367 25554 raft_consensus.cc:3037] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:08.160766 23470 rpcz_store.cc:276] 0807 13:39:06.499251 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:08.113462 (+1614211us) service_pool.cc:227] Handling call
0807 13:39:08.159050 (+ 45588us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:08.159915 (+ 865us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:08.160188 (+ 273us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:08.161445 25409 leader_election.cc:288] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:08.053020 25403 consensus_queue.cc:1035] T b078a19f38494b04ad11b14d98ec4bca P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.241s
I20260807 13:39:08.166992 23478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 519) took 1669 ms. Trace:
I20260807 13:39:08.167457 23478 rpcz_store.cc:276] 0807 13:39:06.497890 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:08.040179 (+1542289us) service_pool.cc:227] Handling call
0807 13:39:08.112908 (+ 72729us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:08.154509 (+ 41601us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:08.154539 (+ 30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:08.154590 (+ 51us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:39:08.166709 (+ 12119us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:08.166777 (+ 68us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:08.166923 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:08.191787 25367 raft_consensus.cc:2726] T 46e552e0aa3f4433858116fa31ee8458 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:39:08.192134 25565 raft_consensus.cc:504] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:08.194504 23582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 525) took 1450 ms. Trace:
I20260807 13:39:08.194959 23582 rpcz_store.cc:276] 0807 13:39:06.744424 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.997963 (+1253539us) service_pool.cc:227] Handling call
0807 13:39:08.095139 (+ 97176us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:08.194120 (+ 98981us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:08.194148 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:08.194192 (+ 44us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:39:08.194238 (+ 46us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:08.194300 (+ 62us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:08.194436 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:08.197077 23470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 663) took 1640 ms. Trace:
I20260807 13:39:08.197561 23470 rpcz_store.cc:276] 0807 13:39:06.556563 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:08.161791 (+1605228us) service_pool.cc:227] Handling call
0807 13:39:08.162245 (+ 454us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:08.162679 (+ 434us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:08.162717 (+ 38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:08.162773 (+ 56us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:08.162813 (+ 40us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:08.170554 (+ 7741us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:08.197005 (+ 26451us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3373,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":16867}
I20260807 13:39:08.123087 23567 tablet_service.cc:1467] Processing CreateTablet for tablet f40430392f094845a0d657f677860f4d (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260807 13:39:08.095249 25301 consensus_queue.cc:1035] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260807 13:39:08.154748 25491 raft_consensus.cc:2781] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader election won for term 2
W20260807 13:39:08.270309 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 107023us
W20260807 13:39:08.275224 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 108403us
I20260807 13:39:08.285022 23473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 659) took 1786 ms. Trace:
I20260807 13:39:08.285565 23473 rpcz_store.cc:276] 0807 13:39:06.498891 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:08.103029 (+1604138us) service_pool.cc:227] Handling call
0807 13:39:08.164700 (+ 61671us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:08.284481 (+119781us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:08.284522 (+ 41us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:08.284587 (+ 65us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:39:08.284636 (+ 49us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:08.284737 (+ 101us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:08.284931 (+ 194us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:08.194525 25306 leader_election.cc:288] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:08.269733 25409 raft_consensus.cc:482] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:08.298662 23346 catalog_manager.cc:5495] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 reported cstate change: term changed from 1 to 2, leader changed from e11cad1eeaf5424c94e51241096f6613 (127.21.69.1) to 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3). New cstate: current_term: 2 leader_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } }
I20260807 13:39:08.274788 25326 raft_consensus.cc:482] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:08.343400 25490 leader_election.cc:288] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:08.299001 25491 raft_consensus.cc:686] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613 [term 2 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:39:08.332463 23470 raft_consensus.cc:1261] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
W20260807 13:39:08.393488 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 353908us
I20260807 13:39:08.398232 23633 leader_election.cc:302] T 4996c3c52ccc41b9a8da11ca747a8e6a P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:08.399767 25529 raft_consensus.cc:3037] T 4996c3c52ccc41b9a8da11ca747a8e6a P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:08.400450 23633 leader_election.cc:302] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:08.400761 23472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 510) took 2460 ms. Trace:
I20260807 13:39:08.402166 23633 leader_election.cc:302] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters: e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:08.401154 23472 rpcz_store.cc:276] 0807 13:39:05.940819 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.562160 (+1621341us) service_pool.cc:227] Handling call
0807 13:39:07.562697 (+ 537us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:07.803016 (+240319us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:07.813246 (+ 10230us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:07.946611 (+133365us) log.cc:842] Serialized 26 byte log entry
0807 13:39:08.140653 (+194042us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:08.140727 (+ 74us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:08.140843 (+ 116us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:08.400496 (+259653us) raft_consensus.cc:1671] finished
0807 13:39:08.400529 (+ 33us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:08.400695 (+ 166us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":358262,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":38652,"thread_start_us":286691,"threads_started":2,"wal-append.queue_time_us":310203}
I20260807 13:39:08.398316 23430 leader_election.cc:302] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:08.404707 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 653) took 2845 ms. Trace:
I20260807 13:39:08.149163 23475 rpcz_store.cc:276] 0807 13:39:05.557615 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.545714 (+1988099us) service_pool.cc:227] Handling call
0807 13:39:07.546207 (+ 493us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:07.547053 (+ 846us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:07.547083 (+ 30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:07.548338 (+ 1255us) log.cc:842] Serialized 26 byte log entry
0807 13:39:07.675123 (+126785us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:07.794370 (+119247us) log.cc:842] Serialized 14 byte log entry
0807 13:39:08.129807 (+335437us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:08.129870 (+ 63us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:08.129905 (+ 35us) raft_consensus.cc:1671] finished
0807 13:39:08.129911 (+ 6us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:08.131284 (+ 1373us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":128526,"prepare.queue_time_us":61800,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":381501,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":327,"spinlock_wait_cycles":3456,"thread_start_us":507311,"threads_started":3,"wal-append.queue_time_us":126733}
I20260807 13:39:08.382575 23564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d4dd3ca60c94d7e891841088eb8f765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:08.383239 23470 pending_rounds.cc:76] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613: Aborting all ops after (but not including) 2
I20260807 13:39:08.414171 25556 raft_consensus.cc:2726] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:39:08.415380 23470 pending_rounds.cc:97] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260807 13:39:08.417706 23470 raft_consensus.cc:2866] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:39:08.417966 25555 consensus_queue.cc:1046] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.107s
I20260807 13:39:08.419013 23470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 669) took 1787 ms. Trace:
I20260807 13:39:08.419548 23470 rpcz_store.cc:276] 0807 13:39:06.632162 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:08.199040 (+1566878us) service_pool.cc:227] Handling call
0807 13:39:08.253368 (+ 54328us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:08.418442 (+165074us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:08.418933 (+ 491us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:08.417029 23430 leader_election.cc:302] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:08.354118 25326 raft_consensus.cc:504] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:08.422878 25326 leader_election.cc:288] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:08.424357 23572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 533) took 1683 ms. Trace:
I20260807 13:39:08.424769 23572 rpcz_store.cc:276] 0807 13:39:06.741358 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.871674 (+1130316us) service_pool.cc:227] Handling call
0807 13:39:07.966959 (+ 95285us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:08.189914 (+222955us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:08.189969 (+ 55us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:08.190054 (+ 85us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:39:08.190111 (+ 57us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:08.424021 (+233910us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54000e9054. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:39:08.424079 (+ 58us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:08.424257 (+ 178us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":511846784}
I20260807 13:39:08.427759 25155 leader_election.cc:288] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:08.428200 25491 consensus_queue.cc:237] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:08.431954 23429 leader_election.cc:302] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:08.432354 25565 leader_election.cc:288] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:08.432945 25565 raft_consensus.cc:2781] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:39:08.433367 25565 raft_consensus.cc:482] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:08.433768 25565 raft_consensus.cc:3037] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:39:08.433812 25540 raft_consensus.cc:3037] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:08.403478 25571 raft_consensus.cc:2781] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:39:08.427196 25526 raft_consensus.cc:2781] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:39:08.405095 23481 rpcz_store.cc:276] 0807 13:39:05.559364 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.556960 (+1997596us) service_pool.cc:227] Handling call
0807 13:39:07.557515 (+ 555us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:07.558030 (+ 515us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:07.558072 (+ 42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:07.558738 (+ 666us) log.cc:842] Serialized 26 byte log entry
0807 13:39:07.802786 (+244048us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:07.855089 (+ 52303us) log.cc:842] Serialized 14 byte log entry
0807 13:39:07.920757 (+ 65668us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:07.920851 (+ 94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:08.404486 (+483635us) raft_consensus.cc:1671] finished
0807 13:39:08.404507 (+ 21us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:08.404652 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":101079,"prepare.queue_time_us":55438,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":4379,"raft.queue_time_us":71165,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":225,"thread_start_us":237484,"threads_started":1,"wal-append.queue_time_us":790997}
I20260807 13:39:08.349282 25409 raft_consensus.cc:504] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:08.449775 24647 consensus_meta.cc:287] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 1.059s user 0.015s sys 0.017s
I20260807 13:39:08.450632 25445 raft_consensus.cc:3032] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:39:08.451051 25445 raft_consensus.cc:729] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:08.451445 23532 leader_election.cc:302] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:08.452250 25557 leader_election.cc:288] T 3d67ad93011c4a87b0ede6554a1608ce P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:08.452831 23532 leader_election.cc:302] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
W20260807 13:39:08.453382 23464 consensus_meta.cc:287] T 0d7a01108a7042148334c054995cba3b P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.929s user 0.017s sys 0.004s
I20260807 13:39:08.453598 25557 raft_consensus.cc:2726] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:39:08.454241 25557 raft_consensus.cc:3037] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:08.462006 25434 raft_consensus.cc:2781] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:39:08.462726 25434 raft_consensus.cc:686] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:08.464188 25287 raft_consensus.cc:504] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:39:08.464547 25445 consensus_queue.cc:260] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:08.465699 25372 leader_election.cc:288] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:39:08.470116 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 374438us
I20260807 13:39:08.423585 25326 raft_consensus.cc:2781] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Leader election won for term 6
W20260807 13:39:08.505724 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 50762us
I20260807 13:39:08.443454 25345 raft_consensus.cc:482] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:08.444209 25526 raft_consensus.cc:482] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:08.466521 25287 leader_election.cc:288] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:08.444716 25302 leader_election.cc:288] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:08.514089 23567 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f40430392f094845a0d657f677860f4d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 13:39:08.544934 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 142932us
I20260807 13:39:08.487443 25571 raft_consensus.cc:686] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 LEADER]: Becoming Leader. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:08.553988 23429 leader_election.cc:302] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:08.547452 23657 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57108 (request call id 77) took 1820 ms. Trace:
I20260807 13:39:08.541232 25526 raft_consensus.cc:3037] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Advancing to term 5
W20260807 13:39:08.571002 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 57112.1us
W20260807 13:39:08.564445 23533 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.509s user 0.005s sys 0.021s
I20260807 13:39:08.549947 25442 leader_election.cc:288] T a1569622b874437badb8e59e749fe7db P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:39:08.572101 23533 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.517s user 0.005s sys 0.021s
W20260807 13:39:08.575791 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 520597us
I20260807 13:39:08.550094 25551 leader_election.cc:288] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:08.558127 25326 raft_consensus.cc:686] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [term 6 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:39:08.560932 25490 raft_consensus.cc:482] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:08.537941 25434 consensus_queue.cc:237] T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:08.579792 25302 consensus_queue.cc:1035] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
I20260807 13:39:08.568708 25301 consensus_queue.cc:1035] T 622dda6b9b914746953c43538b53bb7e P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260807 13:39:08.578934 25367 raft_consensus.cc:482] T 356c6b3e51454d418acaa9be70bb9689 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:08.591868 25579 tablet_bootstrap.cc:492] T 0d7a01108a7042148334c054995cba3b P 9ae273efd33642ad970ab8d1973917c1: Bootstrap starting.
I20260807 13:39:08.616088 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9fcdd060ef64874a8719c95b2325942" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:08.555850 25345 raft_consensus.cc:504] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:08.696461 23565 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49032 (request call id 82) took 1887 ms. Trace:
I20260807 13:39:08.584769 25372 raft_consensus.cc:2781] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:39:08.617136 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea6ae70649fa43bba8052b66977418f5" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:08.725159 23565 rpcz_store.cc:276] 0807 13:39:06.808831 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.812392 (+ 3561us) service_pool.cc:227] Handling call
0807 13:39:07.609415 (+797023us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:07.609608 (+ 193us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:08.113555 (+503947us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:08.599700 (+486145us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:08.696376 (+ 96676us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:39:08.626698 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 44010.6us
I20260807 13:39:08.729992 23473 raft_consensus.cc:2454] T ea6ae70649fa43bba8052b66977418f5 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
W20260807 13:39:08.731832 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 104615us
W20260807 13:39:08.610000 23684 consensus_meta.cc:287] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.739s user 0.052s sys 0.108s
W20260807 13:39:08.610267 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 46909.5us
W20260807 13:39:08.745941 25482 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s user 0.010s sys 0.037s
W20260807 13:39:08.746409 25482 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s user 0.010s sys 0.037s
I20260807 13:39:08.747219 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:08.749982 23570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23e06eb23c7549ca833574823dc2f8a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:08.751034 23561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd8a99f8a43a4481a51b4d339f14bfdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:08.752748 23563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cea21e439be142e588f12ee16d5f71b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:08.747225 23464 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33966 (request call id 76) took 2609 ms. Trace:
I20260807 13:39:08.754683 23560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 566a7784d04c469483a0a06b376eb089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:08.754873 23464 rpcz_store.cc:276] 0807 13:39:06.120959 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.123153 (+ 2194us) service_pool.cc:227] Handling call
0807 13:39:06.332423 (+209270us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:06.332552 (+ 129us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:07.523510 (+1190958us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:08.453971 (+930461us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:08.729849 (+275878us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":108220,"threads_started":1}
I20260807 13:39:08.756688 25287 raft_consensus.cc:482] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:08.757323 25287 raft_consensus.cc:504] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:08.762708 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:08.795966 25409 leader_election.cc:288] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:08.797683 25428 raft_consensus.cc:482] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:08.799196 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:08.623855 25487 leader_election.cc:288] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:08.702539 25155 consensus_queue.cc:1035] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.108s
I20260807 13:39:08.806128 25428 raft_consensus.cc:504] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:08.869244 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:08.732147 25372 raft_consensus.cc:482] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:08.811848 23674 raft_consensus.cc:2454] T f846254307f64297ae642172f37ab394 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4.
I20260807 13:39:08.812826 23684 raft_consensus.cc:1261] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260807 13:39:08.616735 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
@ 0x7fc69531ae2d testing::UnitTest::Run() at ??:0
I20260807 13:39:08.589282 25311 raft_consensus.cc:482] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:39:08.625308 25273 consensus_meta.cc:287] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 1.201s user 0.020s sys 0.005s
@ 0x36966c RUN_ALL_TESTS() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:?
I20260807 13:39:08.870287 25372 raft_consensus.cc:3037] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:08.869985 25558 raft_consensus.cc:3032] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:39:08.720136 25367 raft_consensus.cc:504] T 356c6b3e51454d418acaa9be70bb9689 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:08.870021 23473 raft_consensus.cc:2362] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 7. Re-sending same reply.
I20260807 13:39:08.892441 25326 consensus_queue.cc:237] T ea6c8df560094315891e2805f0b21791 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
@ 0x36852d main at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_main.cc:?
I20260807 13:39:08.614203 23470 raft_consensus.cc:1261] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Refusing update from remote peer 9ae273efd33642ad970ab8d1973917c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:39:08.628585 25490 raft_consensus.cc:504] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:08.943989 23565 tablet_service.cc:1467] Processing CreateTablet for tablet c9b09df756c14aa29e17459696a886a1 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260807 13:39:08.948220 23565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9b09df756c14aa29e17459696a886a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:08.902820 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:08.609242 24647 raft_consensus.cc:482] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:08.568100 23657 rpcz_store.cc:276] 0807 13:39:06.449501 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.451881 (+ 2380us) service_pool.cc:227] Handling call
0807 13:39:06.453717 (+ 1836us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:06.453827 (+ 110us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:07.422643 (+968816us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:07.836234 (+413591us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:08.266994 (+430760us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":349500,"threads_started":1}
I20260807 13:39:08.871758 23684 pending_rounds.cc:76] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Aborting all ops after (but not including) 2
I20260807 13:39:08.964866 23684 pending_rounds.cc:97] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260807 13:39:08.965225 23684 raft_consensus.cc:2866] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:39:08.910440 25558 raft_consensus.cc:729] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:08.972401 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:08.927903 25306 raft_consensus.cc:482] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:08.933125 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:08.936548 23662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24d412bb0b294eeaabde57c850783dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:08.937463 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:08.937870 23479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 642) took 3380 ms. Trace:
W20260807 13:39:08.941286 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 73738.2us
W20260807 13:39:08.943148 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 47157.9us
I20260807 13:39:08.979764 23473 raft_consensus.cc:3037] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Advancing to term 7
W20260807 13:39:08.979065 23478 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s user 0.011s sys 0.030s
W20260807 13:39:08.981325 23478 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s user 0.011s sys 0.031s
I20260807 13:39:08.991041 23674 raft_consensus.cc:3037] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 5
I20260807 13:39:08.995911 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e552e0aa3f4433858116fa31ee8458" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:08.921008 25311 raft_consensus.cc:504] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:08.979697 23479 rpcz_store.cc:276] 0807 13:39:05.557020 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.542520 (+1985500us) service_pool.cc:227] Handling call
0807 13:39:07.542998 (+ 478us) raft_consensus.cc:1457] Updating replica for 3 ops
0807 13:39:07.848064 (+305066us) raft_consensus.cc:1520] Early marking committed up to index 1
0807 13:39:07.983289 (+135225us) log.cc:842] Serialized 14 byte log entry
0807 13:39:08.271163 (+287874us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:39:08.286973 (+ 15810us) log.cc:842] Serialized 52 byte log entry
0807 13:39:08.287560 (+ 587us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:39:08.329687 (+ 42127us) log.cc:842] Serialized 14 byte log entry
0807 13:39:08.347701 (+ 18014us) log.cc:842] Serialized 14 byte log entry
0807 13:39:08.385378 (+ 37677us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:08.385501 (+ 123us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:08.937595 (+552094us) raft_consensus.cc:1671] finished
0807 13:39:08.937618 (+ 23us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:08.937790 (+ 172us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":154863,"prepare.queue_time_us":163590,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":66,"raft.queue_time_us":531940,"raft.run_cpu_time_us":833,"raft.run_wall_time_us":81313,"spinlock_wait_cycles":24113408,"thread_start_us":347273,"threads_started":2,"wal-append.queue_time_us":835568}
I20260807 13:39:08.620726 25571 consensus_queue.cc:237] T 448ac0b9f0f0494cbeb234299ad5cc22 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.025158 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:08.988101 25367 leader_election.cc:288] T 356c6b3e51454d418acaa9be70bb9689 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
W20260807 13:39:09.007766 25529 consensus_meta.cc:287] T 4996c3c52ccc41b9a8da11ca747a8e6a P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.607s user 0.010s sys 0.012s
I20260807 13:39:09.024566 25428 leader_election.cc:288] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:08.945992 25273 raft_consensus.cc:504] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:09.049214 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 429848us
I20260807 13:39:09.050613 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:09.036773 25526 raft_consensus.cc:504] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.038295 23669 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57108 (request call id 79) took 2551 ms. Trace:
I20260807 13:39:09.039417 23661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46cd5d7fc0cd4f06aa175ad4406c7845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:09.040062 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:09.040637 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:09.042723 25302 consensus_queue.cc:1035] T a523d2840d4a4565b8051820b04b147f P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:09.043998 25597 tablet_bootstrap.cc:492] T 566a7784d04c469483a0a06b376eb089 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Bootstrap starting.
I20260807 13:39:09.063560 23684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 646) took 1754 ms. Trace:
I20260807 13:39:09.045580 23657 tablet_service.cc:1467] Processing CreateTablet for tablet 02cac2e1f00446668f33a2bf5fbbd4de (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260807 13:39:09.047921 23571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 527) took 2259 ms. Trace:
I20260807 13:39:09.052627 23429 leader_election.cc:302] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
W20260807 13:39:09.053422 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 70915.2us
I20260807 13:39:09.059768 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:09.086644 23571 rpcz_store.cc:276] 0807 13:39:06.788123 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.995553 (+1207430us) service_pool.cc:227] Handling call
0807 13:39:09.047139 (+1051586us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfb52b0 00007fc69cfa07f9 00007fc69cfa02a2 00007fc696686684
0807 13:39:09.047332 (+ 193us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:09.047537 (+ 205us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:09.047564 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:09.047607 (+ 43us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:09.047671 (+ 64us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:09.047742 (+ 71us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:09.047859 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4058496}
I20260807 13:39:08.987162 25306 raft_consensus.cc:504] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.063779 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220c24fa0c52459182e1e89c74331f3b" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:08.991521 24647 raft_consensus.cc:504] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.051762 25529 raft_consensus.cc:2726] T 4996c3c52ccc41b9a8da11ca747a8e6a P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:39:09.053251 25428 raft_consensus.cc:482] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:09.124106 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4996c3c52ccc41b9a8da11ca747a8e6a" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
W20260807 13:39:09.099509 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 46975.8us
I20260807 13:39:09.067538 23684 rpcz_store.cc:276] 0807 13:39:07.299428 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.304389 (+ 4961us) service_pool.cc:227] Handling call
0807 13:39:07.304624 (+ 235us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:09.007049 (+1702425us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:09.054060 (+ 47011us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:09.055406 23559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49032 (request call id 78) took 2549 ms. Trace:
W20260807 13:39:09.084659 23326 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 273978us
I20260807 13:39:09.130980 23565 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49032 (request call id 87) took 1789 ms. Trace:
I20260807 13:39:09.131466 23680 raft_consensus.cc:3037] T 4996c3c52ccc41b9a8da11ca747a8e6a P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:09.133697 23479 raft_consensus.cc:2379] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:39:09.086407 25287 leader_election.cc:288] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:09.058722 25345 leader_election.cc:288] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:09.137316 23475 raft_consensus.cc:2379] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 4: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:39:09.138916 23580 raft_consensus.cc:2379] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 5: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:39:09.131387 23565 rpcz_store.cc:276] 0807 13:39:07.337204 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:08.899844 (+1562640us) service_pool.cc:227] Handling call
0807 13:39:08.947583 (+ 47739us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:08.947735 (+ 152us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:09.032659 (+ 84924us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:09.091926 (+ 59267us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:09.126252 (+ 34326us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:09.141149 23565 tablet_service.cc:1467] Processing CreateTablet for tablet f6cf62903437494c9280c9bf34653cb1 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260807 13:39:09.142225 23565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6cf62903437494c9280c9bf34653cb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:09.143803 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:09.151193 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:09.124200 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:39:09.137995 25316 consensus_meta.cc:287] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.999s user 0.011s sys 0.024s
I20260807 13:39:09.158447 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:09.124240 25578 raft_consensus.cc:482] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
W20260807 13:39:09.163671 25498 consensus_meta.cc:287] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 1.167s user 0.035s sys 0.019s
I20260807 13:39:09.159755 23475 raft_consensus.cc:2454] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
I20260807 13:39:09.164981 23677 raft_consensus.cc:2454] T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 5.
I20260807 13:39:09.157083 23663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23e06eb23c7549ca833574823dc2f8a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:09.173434 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:39:09.186596 25361 consensus_meta.cc:287] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 1.343s user 0.017s sys 0.013s
I20260807 13:39:09.187242 23676 raft_consensus.cc:2454] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4.
I20260807 13:39:09.188145 25526 leader_election.cc:288] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:09.190038 23633 leader_election.cc:302] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:09.192632 25361 raft_consensus.cc:2726] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:39:09.149446 25599 raft_consensus.cc:482] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:09.054836 23669 rpcz_store.cc:276] 0807 13:39:06.486606 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.486772 (+ 166us) service_pool.cc:227] Handling call
0807 13:39:06.518834 (+ 32062us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:06.518963 (+ 129us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:07.225234 (+706271us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:08.091611 (+866377us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:09.038219 (+946608us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:09.216711 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:39:09.198472 25589 log.cc:924] Time spent T 46e552e0aa3f4433858116fa31ee8458 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.413s user 0.002s sys 0.000s
W20260807 13:39:09.194342 23533 consensus_peers.cc:487] T fcdef01e85a44e1093dd335055986423 P 9ae273efd33642ad970ab8d1973917c1 -> Peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Couldn't send request to peer 5e0ea5aa0c6d4846a5ccc9962342e17a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
W20260807 13:39:09.227748 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 103367us
W20260807 13:39:09.204757 25165 consensus_meta.cc:287] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 1.154s user 0.028s sys 0.007s
I20260807 13:39:09.229626 23468 tablet_service.cc:1467] Processing CreateTablet for tablet 46cd5d7fc0cd4f06aa175ad4406c7845 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260807 13:39:09.231243 23671 raft_consensus.cc:3032] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Stepping down as leader of term 1
W20260807 13:39:09.231763 23455 consensus_meta.cc:287] T 566a7784d04c469483a0a06b376eb089 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 1.651s user 0.017s sys 0.013s
I20260807 13:39:09.232064 25611 raft_consensus.cc:482] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:09.232411 23657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02cac2e1f00446668f33a2bf5fbbd4de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:09.225520 25602 tablet_bootstrap.cc:492] T 0d7a01108a7042148334c054995cba3b P e11cad1eeaf5424c94e51241096f6613: Bootstrap starting.
W20260807 13:39:09.232924 23407 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:39:09.234972 23566 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49032 (request call id 79) took 2719 ms. Trace:
I20260807 13:39:09.202836 25599 raft_consensus.cc:504] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.237152 23463 tablet_service.cc:1467] Processing CreateTablet for tablet f40430392f094845a0d657f677860f4d (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260807 13:39:09.129915 23559 rpcz_store.cc:276] 0807 13:39:06.498204 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.498355 (+ 151us) service_pool.cc:227] Handling call
0807 13:39:06.867801 (+369446us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:07.578497 (+710696us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc695100465 00007fc69cfea9b8 00007fc69cfeb39d 00007fc69cf9c869 00007fc69659ec44 00007fc69659ebd2 00007fc69659eb01 00007fc69659ea7c 00007fc69659dd32 00007fc69648994c
0807 13:39:07.601917 (+ 23420us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:08.506009 (+904092us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:09.047235 (+541226us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:09.047764 (+ 529us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":730107776}
I20260807 13:39:09.149817 25428 raft_consensus.cc:504] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:09.204638 25554 consensus_meta.cc:287] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 1.044s user 0.011s sys 0.012s
I20260807 13:39:09.235507 23680 raft_consensus.cc:2454] T 4996c3c52ccc41b9a8da11ca747a8e6a P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:39:09.167433 25316 raft_consensus.cc:504] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.245877 23671 raft_consensus.cc:729] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:09.168429 25498 raft_consensus.cc:504] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.232461 25377 raft_consensus.cc:2781] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:39:09.168452 23470 raft_consensus.cc:2454] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 5.
I20260807 13:39:09.135082 25558 consensus_queue.cc:260] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.305485 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:09.295892 23565 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49032 (request call id 88) took 1722 ms. Trace:
I20260807 13:39:09.248831 25490 leader_election.cc:288] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:09.304028 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:09.247545 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:09.306329 23565 rpcz_store.cc:276] 0807 13:39:07.573970 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:09.140312 (+1566342us) service_pool.cc:227] Handling call
0807 13:39:09.141878 (+ 1566us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:09.141949 (+ 71us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:09.245502 (+103553us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:09.295148 (+ 49646us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:09.295801 (+ 653us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:09.181196 25578 raft_consensus.cc:504] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.346834 23565 tablet_service.cc:1467] Processing CreateTablet for tablet 02cac2e1f00446668f33a2bf5fbbd4de (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260807 13:39:09.349121 23565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02cac2e1f00446668f33a2bf5fbbd4de. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 13:39:09.350615 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 100666us
W20260807 13:39:09.351058 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 56178.1us
I20260807 13:39:09.353914 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:09.340997 23671 consensus_queue.cc:260] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:09.349752 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 146437us
W20260807 13:39:09.371758 25322 consensus_meta.cc:287] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 1.357s user 0.007s sys 0.021s
I20260807 13:39:09.372061 25316 leader_election.cc:288] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:39:09.372390 25265 consensus_meta.cc:287] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 1.377s user 0.018s sys 0.018s
I20260807 13:39:09.372777 25265 raft_consensus.cc:504] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.373914 23574 raft_consensus.cc:1226] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 3. Current term is 4. Ops: []
I20260807 13:39:09.225394 25598 consensus_queue.cc:1046] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.316s
I20260807 13:39:09.359383 23460 tablet_service.cc:1467] Processing CreateTablet for tablet 2d4dd3ca60c94d7e891841088eb8f765 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260807 13:39:09.360857 25428 leader_election.cc:288] T 4c074cd105794bf1a00bd3a9f449a323 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:09.365309 23671 raft_consensus.cc:3037] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:09.370078 23478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 664) took 2776 ms. Trace:
I20260807 13:39:09.309561 25311 leader_election.cc:288] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:09.250416 25165 raft_consensus.cc:504] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.377596 23674 raft_consensus.cc:2454] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 5.
I20260807 13:39:09.303617 25377 raft_consensus.cc:482] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
W20260807 13:39:09.357190 25557 consensus_meta.cc:287] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.902s user 0.004s sys 0.019s
I20260807 13:39:09.354001 25273 leader_election.cc:288] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:09.381613 23478 rpcz_store.cc:276] 0807 13:39:06.594001 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:08.199312 (+1605311us) service_pool.cc:227] Handling call
0807 13:39:08.309504 (+110192us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:08.310021 (+ 517us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:08.310058 (+ 37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:08.310659 (+ 601us) log.cc:842] Serialized 26 byte log entry
0807 13:39:08.995281 (+684622us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:09.054307 (+ 59026us) log.cc:842] Serialized 14 byte log entry
0807 13:39:09.058454 (+ 4147us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:09.058536 (+ 82us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:09.369818 (+311282us) raft_consensus.cc:1671] finished
0807 13:39:09.369841 (+ 23us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:09.370009 (+ 168us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":62877,"prepare.queue_time_us":49392,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":19295,"raft.queue_time_us":3843,"raft.run_cpu_time_us":368,"raft.run_wall_time_us":54508,"spinlock_wait_cycles":7621376,"thread_start_us":670744,"threads_started":1,"wal-append.queue_time_us":899455}
I20260807 13:39:09.248911 23464 tablet_service.cc:1467] Processing CreateTablet for tablet cea21e439be142e588f12ee16d5f71b1 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260807 13:39:09.257620 25611 raft_consensus.cc:504] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.253412 23566 rpcz_store.cc:276] 0807 13:39:06.515078 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.520096 (+ 5018us) service_pool.cc:227] Handling call
0807 13:39:06.804591 (+284495us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:06.818353 (+ 13762us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:08.569131 (+1750778us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:09.234222 (+665091us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:09.234761 (+ 539us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:09.390954 25377 raft_consensus.cc:3037] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:09.395838 23665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cea21e439be142e588f12ee16d5f71b1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 13:39:09.395923 23659 consensus_meta.cc:287] T 508c989e13ca4c47b5e2982478c5d328 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.576s user 0.007s sys 0.007s
W20260807 13:39:09.395512 25609 log.cc:924] Time spent T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.152s user 0.001s sys 0.000s
I20260807 13:39:09.385183 25155 raft_consensus.cc:482] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:09.416795 25628 consensus_queue.cc:1035] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:39:09.416918 25482 consensus_queue.cc:1046] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:39:09.417692 25468 ts_tablet_manager.cc:1918] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260807 13:39:09.417946 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 501) took 3988 ms. Trace:
I20260807 13:39:09.418532 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:09.424026 25599 leader_election.cc:288] T a2d9eca137dd4e03bdcaa721491ef3c0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:09.425150 25361 consensus_queue.cc:1046] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260807 13:39:09.426491 25372 consensus_meta.cc:287] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.525s user 0.004s sys 0.004s
I20260807 13:39:09.390316 25557 raft_consensus.cc:2726] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:39:09.430025 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 47328us
I20260807 13:39:09.437273 23575 raft_consensus.cc:1261] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260807 13:39:09.438213 23559 tablet_service.cc:1467] Processing CreateTablet for tablet 19ee3f9a953c4bbd889fc7001a63fec1 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260807 13:39:09.439059 25445 raft_consensus.cc:3037] T 2b1542e790794928a76e4b29a1d7732b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:09.439927 25522 ts_tablet_manager.cc:1918] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260807 13:39:09.440727 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:09.441700 23462 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33966 (request call id 81) took 2808 ms. Trace:
I20260807 13:39:09.443553 23468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46cd5d7fc0cd4f06aa175ad4406c7845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:09.443987 23455 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33966 (request call id 77) took 3251 ms. Trace:
I20260807 13:39:09.508699 23455 rpcz_store.cc:276] 0807 13:39:06.192598 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.194538 (+ 1940us) service_pool.cc:227] Handling call
0807 13:39:06.557985 (+363447us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:06.583274 (+ 25289us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:07.491895 (+908621us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:09.283311 (+1791416us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:09.443907 (+160596us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:09.510462 25306 leader_election.cc:288] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:09.512183 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:09.514858 25409 raft_consensus.cc:482] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:09.515580 25409 raft_consensus.cc:504] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.515880 23566 tablet_service.cc:1467] Processing CreateTablet for tablet 1bef6ef007eb4dd18759fb406e70535c (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260807 13:39:09.518477 25409 leader_election.cc:288] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:09.519184 23574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 526) took 2741 ms. Trace:
I20260807 13:39:09.519574 23574 rpcz_store.cc:276] 0807 13:39:06.777771 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:08.022552 (+1244781us) service_pool.cc:227] Handling call
0807 13:39:08.068933 (+ 46381us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:09.374306 (+1305373us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:09.518928 (+144622us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400377154. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:39:09.519120 (+ 192us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3000739200}
W20260807 13:39:09.520386 25603 log.cc:924] Time spent T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.311s user 0.003s sys 0.000s
I20260807 13:39:09.521610 25619 raft_consensus.cc:3032] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:39:09.521991 25428 raft_consensus.cc:3032] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:39:09.522222 25619 raft_consensus.cc:729] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:09.522506 25428 raft_consensus.cc:729] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
W20260807 13:39:09.444480 25618 log.cc:924] Time spent T ea167f614ede4fb0b327431be74e98b0 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.139s user 0.000s sys 0.000s
W20260807 13:39:09.444864 23469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 661) took 2906 ms (client timeout 1773 ms). Trace:
I20260807 13:39:09.445176 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:09.445503 24931 raft_consensus.cc:3032] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:39:09.532605 24931 raft_consensus.cc:729] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:09.397007 25558 raft_consensus.cc:3037] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:09.449739 23679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 554) took 2672 ms. Trace:
I20260807 13:39:09.395709 23669 tablet_service.cc:1467] Processing CreateTablet for tablet f40430392f094845a0d657f677860f4d (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260807 13:39:09.451272 23671 raft_consensus.cc:1261] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260807 13:39:09.390376 24647 leader_election.cc:288] T 944b1327a944412b8ef8b5a60f96fb2d P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:09.533509 24931 consensus_queue.cc:260] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.536513 23679 rpcz_store.cc:276] 0807 13:39:06.740741 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.740891 (+ 150us) service_pool.cc:227] Handling call
0807 13:39:06.741236 (+ 345us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:06.771858 (+ 30622us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:06.771889 (+ 31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:07.811018 (+1039129us) spinlock_profiling.cc:243] Waited 6.72 ms on lock 0x7b2c000a2b08. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc696a42e11 00007fc696a52442 00007fc69809ac11 00007fc69805f58a 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772
0807 13:39:07.823912 (+ 12894us) log.cc:842] Serialized 26 byte log entry
0807 13:39:08.076938 (+253026us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:39:08.116001 (+ 39063us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:08.131131 (+ 15130us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:09.396043 (+1264912us) raft_consensus.cc:1671] finished
0807 13:39:09.396061 (+ 18us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:09.412714 (+ 16653us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":30160,"raft.queue_time_us":30800,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":5053,"spinlock_wait_cycles":15460096,"thread_start_us":150081,"threads_started":1,"wal-append.queue_time_us":889110}
I20260807 13:39:09.540592 24931 raft_consensus.cc:3037] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:39:09.542234 23670 consensus_meta.cc:287] T 0d7a01108a7042148334c054995cba3b P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.502s user 0.007s sys 0.003s
I20260807 13:39:09.543941 25490 raft_consensus.cc:482] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:09.460175 25155 raft_consensus.cc:504] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.464003 23676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:09.464100 25578 leader_election.cc:288] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:09.544567 25490 raft_consensus.cc:504] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:09.470585 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 56170.3us
I20260807 13:39:09.468400 23480 rpcz_store.cc:276] 0807 13:39:05.429935 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.392513 (+1962578us) service_pool.cc:227] Handling call
0807 13:39:07.402694 (+ 10181us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:08.068421 (+665727us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:09.417633 (+1349212us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b5400085554. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:39:09.417879 (+ 246us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1386854656}
W20260807 13:39:09.476234 25614 log.cc:924] Time spent T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613: Append to log took a long time: real 0.088s user 0.001s sys 0.000s
I20260807 13:39:09.476593 23571 raft_consensus.cc:2379] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 4: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:39:09.477413 23572 raft_consensus.cc:1226] T d36f9c3051e24fba90a7a4418204d381 P 9ae273efd33642ad970ab8d1973917c1 [term 4 LEADER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 3. Current term is 4. Ops: []
W20260807 13:39:09.460500 23458 consensus_meta.cc:287] T e6d26fd195cb4bf4bd91ba45a72f87ac P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.723s user 0.010s sys 0.000s
I20260807 13:39:09.485538 23575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 532) took 2845 ms. Trace:
I20260807 13:39:09.482280 23473 raft_consensus.cc:2454] T 70dd63c6fc214c5882dd73c5f05fad72 P e11cad1eeaf5424c94e51241096f6613 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 7.
I20260807 13:39:09.493458 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:09.458956 25265 leader_election.cc:288] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:39:09.482829 25540 consensus_meta.cc:287] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 1.048s user 0.008s sys 0.024s
I20260807 13:39:09.502343 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "647de9e979b94eddb7556f6737c7358b" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:09.501655 25522 log.cc:1196] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1: Deleting WAL directory at /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109844500879-21780-0/minicluster-data/ts-1-root/wals/95c5e5bf2dd94ffc98d4ac0c6876c02e
I20260807 13:39:09.508302 23472 raft_consensus.cc:2379] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 5: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:39:09.499795 23462 rpcz_store.cc:276] 0807 13:39:06.633633 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.634725 (+ 1092us) service_pool.cc:227] Handling call
0807 13:39:07.502409 (+867684us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b5800003398. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69d00dd21 00007fc69cfeb1e3 00007fc69cf9c869 00007fc69659ec44 00007fc69659ebd2 00007fc69659eb01
0807 13:39:07.503979 (+ 1570us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:07.504162 (+ 183us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:09.011210 (+1507048us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:09.160910 (+149700us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:09.441625 (+280715us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":50390400}
I20260807 13:39:09.524192 25400 raft_consensus.cc:3032] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:39:09.523594 25428 consensus_queue.cc:260] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.529809 23463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f40430392f094845a0d657f677860f4d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 13:39:09.497901 23465 consensus_meta.cc:287] T dd8a99f8a43a4481a51b4d339f14bfdc P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 1.404s user 0.027s sys 0.034s
W20260807 13:39:09.530905 23469 rpcz_store.cc:269] 0807 13:39:06.538954 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.552758 (+ 13804us) service_pool.cc:227] Handling call
0807 13:39:09.444584 (+2891826us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400172fd4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:39:09.444773 (+ 189us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3108599296}
W20260807 13:39:09.535759 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 141683us
I20260807 13:39:09.538389 23671 pending_rounds.cc:76] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Aborting all ops after (but not including) 0
I20260807 13:39:09.566793 23671 pending_rounds.cc:97] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260807 13:39:09.524511 25468 log.cc:1196] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613: Deleting WAL directory at /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109844500879-21780-0/minicluster-data/ts-0-root/wals/95c5e5bf2dd94ffc98d4ac0c6876c02e
I20260807 13:39:09.552560 23575 rpcz_store.cc:276] 0807 13:39:06.638604 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:09.436337 (+2797733us) service_pool.cc:227] Handling call
0807 13:39:09.436826 (+ 489us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:09.484137 (+ 47311us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:09.484372 (+ 235us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:09.554530 23674 pending_rounds.cc:76] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a: Aborting all ops after (but not including) 1
I20260807 13:39:09.567538 23462 tablet_service.cc:1467] Processing CreateTablet for tablet c9b09df756c14aa29e17459696a886a1 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260807 13:39:09.570226 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e552e0aa3f4433858116fa31ee8458" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:09.485381 25372 raft_consensus.cc:504] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.563048 23668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d4dd3ca60c94d7e891841088eb8f765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:09.563573 23677 raft_consensus.cc:2454] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4.
I20260807 13:39:09.555115 25442 raft_consensus.cc:482] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:09.543224 23429 leader_election.cc:302] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:09.598253 25442 raft_consensus.cc:504] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:09.598892 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 55782.2us
I20260807 13:39:09.599586 23429 leader_election.cc:302] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:09.600350 25442 leader_election.cc:288] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:09.601001 23429 leader_election.cc:302] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:09.601786 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:09.601907 23429 leader_election.cc:302] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:09.598268 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:09.603026 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a3da79d3b0447cbc19c4f28279e134" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:09.603191 23575 raft_consensus.cc:2454] T 173a6c34d23a480793ef93a33940fa0f P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:39:09.567271 23671 raft_consensus.cc:2866] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:39:09.567786 23574 raft_consensus.cc:1226] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260807 13:39:09.604140 25301 raft_consensus.cc:3032] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:39:09.604406 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a42b974d289d402ea12744b7caf94ae8" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:09.604547 25301 raft_consensus.cc:729] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Running, Role: LEADER
I20260807 13:39:09.604918 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae09b72e43be4ee7a4c56900f3f31fdb" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:09.537654 23455 tablet_service.cc:1467] Processing CreateTablet for tablet f6cf62903437494c9280c9bf34653cb1 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260807 13:39:09.569409 23674 pending_rounds.cc:97] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 13:39:09.572964 23465 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33966 (request call id 80) took 2939 ms. Trace:
I20260807 13:39:09.605512 25301 consensus_queue.cc:260] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.606109 23465 rpcz_store.cc:276] 0807 13:39:06.633346 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.634876 (+ 1530us) service_pool.cc:227] Handling call
0807 13:39:07.500384 (+865508us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:07.500776 (+ 392us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:08.090807 (+590031us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:09.572317 (+1481510us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:09.572896 (+ 579us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:09.606889 25301 raft_consensus.cc:3037] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:09.608176 23465 tablet_service.cc:1467] Processing CreateTablet for tablet 02cac2e1f00446668f33a2bf5fbbd4de (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260807 13:39:09.573205 25331 raft_consensus.cc:482] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:09.609674 25331 raft_consensus.cc:504] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.557567 25498 leader_election.cc:288] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:09.587842 25428 raft_consensus.cc:3037] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:39:09.612020 25331 leader_election.cc:288] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:09.612183 25570 raft_consensus.cc:2781] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:39:09.612589 25570 raft_consensus.cc:482] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:09.612833 23674 raft_consensus.cc:2866] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:39:09.612980 25570 raft_consensus.cc:3037] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:39:09.613406 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:09.613711 25306 raft_consensus.cc:2781] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:39:09.614318 25306 raft_consensus.cc:686] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [term 3 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:39:09.573485 25273 raft_consensus.cc:482] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:09.576243 25608 raft_consensus.cc:482] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:09.580688 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:09.573503 25468 ts_tablet_manager.cc:1939] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613: Deleting consensus metadata
I20260807 13:39:09.580921 25186 consensus_queue.cc:1046] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:39:09.562819 25400 raft_consensus.cc:729] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:09.582785 23458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33966 (request call id 79) took 2949 ms. Trace:
I20260807 13:39:09.565557 23559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19ee3f9a953c4bbd889fc7001a63fec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:09.572984 25155 leader_election.cc:288] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:09.604035 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:09.584383 25165 leader_election.cc:288] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 8 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:09.561360 23659 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57108 (request call id 78) took 3111 ms. Trace:
W20260807 13:39:09.586886 25565 consensus_meta.cc:287] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 1.153s user 0.024s sys 0.000s
I20260807 13:39:09.573863 25522 ts_tablet_manager.cc:1939] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P 9ae273efd33642ad970ab8d1973917c1: Deleting consensus metadata
W20260807 13:39:09.556501 23580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 537) took 2807 ms (client timeout 2207 ms). Trace:
I20260807 13:39:09.591730 23471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33972 (request call id 654) took 3295 ms. Trace:
I20260807 13:39:09.593377 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c5e5bf2dd94ffc98d4ac0c6876c02e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:09.594532 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:09.594798 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "356c6b3e51454d418acaa9be70bb9689" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:09.595800 25557 raft_consensus.cc:482] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:09.596140 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9fcdd060ef64874a8719c95b2325942" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:09.630558 23577 raft_consensus.cc:2454] T b9fcdd060ef64874a8719c95b2325942 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 2.
I20260807 13:39:09.596930 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1bcab9bf8fc4a508a914326892a42a9" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:09.597455 25628 raft_consensus.cc:482] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:09.597388 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:09.605063 23575 raft_consensus.cc:2454] T a42b974d289d402ea12744b7caf94ae8 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:39:09.614204 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:09.632006 23671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 557) took 2857 ms. Trace:
W20260807 13:39:09.629541 23580 rpcz_store.cc:269] 0807 13:39:06.742462 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.333786 (+591324us) service_pool.cc:227] Handling call
0807 13:39:07.605162 (+271376us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ffb7c 00007fc6950ff73b 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:39:09.537264 (+1932102us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540024dbd4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:39:09.549580 (+ 12316us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3027501696}
I20260807 13:39:09.559744 23565 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49032 (request call id 89) took 1985 ms. Trace:
I20260807 13:39:09.554162 23532 leader_election.cc:302] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:09.614715 23677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:39:09.621809 23429 leader_election.cc:341] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 pre-election: Tablet error from VoteRequest() call to peer 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765): Illegal state: Tablet not RUNNING: STOPPED
I20260807 13:39:09.615948 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "220c24fa0c52459182e1e89c74331f3b" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:09.618749 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a3da79d3b0447cbc19c4f28279e134" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
W20260807 13:39:09.614948 25359 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260807 13:39:09.696345 23684 raft_consensus.cc:2396] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:39:09.632385 23671 rpcz_store.cc:276] 0807 13:39:06.774406 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.774561 (+ 155us) service_pool.cc:227] Handling call
0807 13:39:06.786980 (+ 12419us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:09.205720 (+2418740us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b54005c1aa0. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc697fef730 00007fc698061300 00007fc698062371 00007fc69805eedf 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc
0807 13:39:09.614631 (+408911us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:09.631957 (+ 17326us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1307824384}
I20260807 13:39:09.615700 25326 raft_consensus.cc:2781] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:39:09.571487 23560 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49032 (request call id 77) took 3263 ms. Trace:
I20260807 13:39:09.627030 23672 raft_consensus.cc:2454] T 05a3da79d3b0447cbc19c4f28279e134 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
W20260807 13:39:09.702472 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 80718.4us
I20260807 13:39:09.595785 23464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cea21e439be142e588f12ee16d5f71b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:09.703289 23677 raft_consensus.cc:2396] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260807 13:39:09.635955 23481 raft_consensus.cc:2454] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 5.
I20260807 13:39:09.701079 23565 rpcz_store.cc:276] 0807 13:39:07.574611 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:09.345937 (+1771326us) service_pool.cc:227] Handling call
0807 13:39:09.348637 (+ 2700us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:09.348734 (+ 97us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:09.480452 (+131718us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:09.558781 (+ 78329us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:09.559679 (+ 898us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:09.586937 23661 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57108 (request call id 85) took 1981 ms. Trace:
I20260807 13:39:09.615525 25526 raft_consensus.cc:2781] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:39:09.712575 23680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:09.706983 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7572ca9ba3b47978ecbc11a3ed09244" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:09.713167 23429 leader_election.cc:302] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:09.706902 23669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f40430392f094845a0d657f677860f4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:09.615224 25608 raft_consensus.cc:504] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.629593 23471 rpcz_store.cc:276] 0807 13:39:06.296542 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.895918 (+1599376us) service_pool.cc:227] Handling call
0807 13:39:07.927589 (+ 31671us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:39:08.092138 (+164549us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:08.092194 (+ 56us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:39:08.093278 (+ 1084us) log.cc:842] Serialized 52 byte log entry
0807 13:39:08.586884 (+493606us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:08.696046 (+109162us) log.cc:842] Serialized 14 byte log entry
0807 13:39:08.721480 (+ 25434us) log.cc:842] Serialized 14 byte log entry
0807 13:39:08.774560 (+ 53080us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:08.774666 (+ 106us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:09.591449 (+816783us) raft_consensus.cc:1671] finished
0807 13:39:09.591470 (+ 21us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:09.591626 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":98374,"prepare.queue_time_us":154121,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":76,"raft.queue_time_us":123692,"raft.run_cpu_time_us":624,"raft.run_wall_time_us":68163,"thread_start_us":492955,"threads_started":1,"wal-append.queue_time_us":1040781}
I20260807 13:39:09.616706 25186 raft_consensus.cc:3032] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:39:09.523613 25619 consensus_queue.cc:260] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.617973 25468 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33966 (request call id 61) took 4427 ms. Trace:
I20260807 13:39:09.621542 23456 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33966 (request call id 82) took 2969 ms. Trace:
W20260807 13:39:09.725136 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 171048us
I20260807 13:39:09.726254 25579 tablet_bootstrap.cc:700] T 0d7a01108a7042148334c054995cba3b P 9ae273efd33642ad970ab8d1973917c1: Time spent opening tablet: real 0.193s user 0.002s sys 0.001s
I20260807 13:39:09.727329 23671 raft_consensus.cc:2454] T f7572ca9ba3b47978ecbc11a3ed09244 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 6.
I20260807 13:39:09.707041 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b6d649ae21a41c9b6723944d7036688" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:09.729616 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:09.696553 25442 raft_consensus.cc:482] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:09.733484 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4746a12996c4987a582df9f569b3c66" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:09.763159 23684 raft_consensus.cc:2396] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:39:09.698101 25522 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49032 (request call id 61) took 3608 ms. Trace:
I20260807 13:39:09.768538 25579 tablet_bootstrap.cc:654] T 0d7a01108a7042148334c054995cba3b P 9ae273efd33642ad970ab8d1973917c1: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:09.767872 25522 rpcz_store.cc:276] 0807 13:39:06.090004 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.122967 (+ 32963us) service_pool.cc:227] Handling call
0807 13:39:06.357134 (+234167us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b44000232cc. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc695049a95 00007fc69504a4b2 00007fc697cf2511 00007fc697cede1a 00007fc6951195fe 00007fc69df50a39 00007fc6951368bb 00007fc695134cbf 00007fc695136e22 00007fc69cfef734
0807 13:39:06.713943 (+356809us) ts_tablet_manager.cc:1145] Deleting tablet 95c5e5bf2dd94ffc98d4ac0c6876c02e
0807 13:39:06.733034 (+ 19091us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 13:39:07.452009 (+718975us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:09.439423 (+1987414us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:09.698011 (+258588us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13972,"spinlock_wait_cycles":30161152,"tablet-delete.queue_time_us":412840,"thread_start_us":383934,"threads_started":1}
I20260807 13:39:09.738373 23480 raft_consensus.cc:1226] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 8 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260807 13:39:09.698282 25490 leader_election.cc:288] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:09.722198 23566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1bef6ef007eb4dd18759fb406e70535c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:09.620986 25540 consensus_queue.cc:1046] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.101s
I20260807 13:39:09.713296 25311 raft_consensus.cc:482] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:09.749073 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:09.741204 23565 tablet_service.cc:1467] Processing CreateTablet for tablet e2a4ce7bb4d64b8596158d5ac194e4a9 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260807 13:39:09.742514 25287 raft_consensus.cc:2781] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:39:09.617434 25400 consensus_queue.cc:260] T 647de9e979b94eddb7556f6737c7358b P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.752153 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1569622b874437badb8e59e749fe7db" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:09.733752 25526 raft_consensus.cc:482] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:09.742849 25186 raft_consensus.cc:729] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:09.779117 23469 raft_consensus.cc:2454] T a1569622b874437badb8e59e749fe7db P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:39:09.756253 23470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "173a6c34d23a480793ef93a33940fa0f" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:09.757469 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a3da79d3b0447cbc19c4f28279e134" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:09.800530 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "448ac0b9f0f0494cbeb234299ad5cc22" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:09.758476 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f846254307f64297ae642172f37ab394" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:09.614967 25273 raft_consensus.cc:504] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
I20260807 13:39:09.721413 25345 raft_consensus.cc:2781] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:39:09.763130 23473 raft_consensus.cc:2454] T f4746a12996c4987a582df9f569b3c66 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
W20260807 13:39:09.806372 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 45308.7us
I20260807 13:39:09.703930 25165 raft_consensus.cc:482] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:09.766220 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:09.819361 23481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33972 (request call id 673) took 1190 ms. Trace:
I20260807 13:39:09.766922 23571 raft_consensus.cc:2454] T 8b6d649ae21a41c9b6723944d7036688 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:39:09.766782 25442 raft_consensus.cc:504] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.733172 25498 raft_consensus.cc:482] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:09.635020 25565 raft_consensus.cc:504] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.778187 25287 raft_consensus.cc:482] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:09.840837 25287 raft_consensus.cc:3037] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:09.841178 25565 leader_election.cc:288] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:09.725688 23661 rpcz_store.cc:276] 0807 13:39:07.605127 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.645870 (+ 40743us) service_pool.cc:227] Handling call
0807 13:39:08.934954 (+1289084us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b5800004298. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ffbce 000000000034aea9 00007fc69cf2ba30 00007fc69d00dd3c 00007fc69cfeb1e3 00007fc69cf9c869 00007fc69659ec44 00007fc69659ebd2 00007fc69659eb01
0807 13:39:09.038855 (+103901us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:09.038988 (+ 133us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:09.477244 (+438256us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:09.586334 (+109090us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:09.586869 (+ 535us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":53881600}
I20260807 13:39:09.749176 25602 tablet_bootstrap.cc:654] T 0d7a01108a7042148334c054995cba3b P e11cad1eeaf5424c94e51241096f6613: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:09.695976 25557 raft_consensus.cc:504] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.843300 23661 tablet_service.cc:1467] Processing CreateTablet for tablet c9b09df756c14aa29e17459696a886a1 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260807 13:39:09.615355 25306 consensus_queue.cc:237] T 4996c3c52ccc41b9a8da11ca747a8e6a P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.844802 25557 leader_election.cc:288] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:09.845793 23581 raft_consensus.cc:2454] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 5.
I20260807 13:39:09.794266 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28395e0788e4418291f95845e9d5e793" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:09.617563 23458 rpcz_store.cc:276] 0807 13:39:06.633033 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.633151 (+ 118us) service_pool.cc:227] Handling call
0807 13:39:07.502348 (+869197us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:07.502679 (+ 331us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:08.587513 (+1084834us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:09.565303 (+977790us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:09.582717 (+ 17414us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:09.733042 25326 raft_consensus.cc:686] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [term 5 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:39:09.796092 25619 raft_consensus.cc:3037] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:39:09.805846 25490 raft_consensus.cc:482] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:09.766932 23573 raft_consensus.cc:1261] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:39:09.805691 25186 consensus_queue.cc:260] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.872932 25186 raft_consensus.cc:3037] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:09.806361 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:09.874454 23480 raft_consensus.cc:3037] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:09.874835 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c49d31823d4cf4adca30ebd1b7eb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:09.807039 25551 consensus_queue.cc:1035] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:39:09.731556 25628 raft_consensus.cc:504] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.773533 23455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6cf62903437494c9280c9bf34653cb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:09.811535 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd7bd21d1d04883878a334d64e518e3" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:09.819818 23481 rpcz_store.cc:276] 0807 13:39:08.612164 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:08.696242 (+ 84078us) service_pool.cc:227] Handling call
0807 13:39:09.802287 (+1106045us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b54000ba4d4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:39:09.802380 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2006487296}
I20260807 13:39:09.801095 23479 raft_consensus.cc:2454] T 05a3da79d3b0447cbc19c4f28279e134 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:39:09.817764 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:09.629535 23659 rpcz_store.cc:276] 0807 13:39:06.449810 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.453299 (+ 3489us) service_pool.cc:227] Handling call
0807 13:39:06.455326 (+ 2027us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:06.455433 (+ 107us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:08.619935 (+2164502us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:09.485004 (+865069us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:09.559103 (+ 74099us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:09.772305 25331 raft_consensus.cc:482] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:09.824218 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea167f614ede4fb0b327431be74e98b0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:09.826448 23657 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57108 (request call id 89) took 2205 ms. Trace:
I20260807 13:39:09.829321 23662 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57108 (request call id 82) took 2416 ms. Trace:
I20260807 13:39:09.830157 25442 leader_election.cc:288] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:09.830178 25522 tablet_replica.cc:330] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1: stopping tablet replica
I20260807 13:39:09.799909 25311 raft_consensus.cc:504] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.832103 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98b1cb53677841e393a54d9204f8959e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:09.832566 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a523d2840d4a4565b8051820b04b147f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:09.761551 23456 rpcz_store.cc:276] 0807 13:39:06.633979 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.636511 (+ 2532us) service_pool.cc:227] Handling call
0807 13:39:07.503950 (+867439us) spinlock_profiling.cc:243] Waited 8.88 ms on lock 0x7b5800003398. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69d00dd21 00007fc69cfeb1e3 00007fc69cf9c869 00007fc69659ec44 00007fc69659ebd2 00007fc69659eb01
0807 13:39:07.505193 (+ 1243us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:07.505385 (+ 192us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:09.431394 (+1926009us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:09.603027 (+171633us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:09.603573 (+ 546us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":20893312}
I20260807 13:39:09.799445 23532 leader_election.cc:302] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:09.791766 25526 raft_consensus.cc:3037] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:09.778118 25611 leader_election.cc:288] T e20c3c18eb474ef5b19f3300b13b17c3 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:09.866667 25326 consensus_queue.cc:237] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.711318 23560 rpcz_store.cc:276] 0807 13:39:06.489184 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.493273 (+ 4089us) service_pool.cc:227] Handling call
0807 13:39:07.571369 (+1078096us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69d00dd21 00007fc69cfeb1e3 00007fc69cf9c869 00007fc69659ec44 00007fc69659ebd2 00007fc69659eb01
0807 13:39:07.607404 (+ 36035us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:07.607572 (+ 168us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:08.963114 (+1355542us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:09.456728 (+493614us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:09.542790 (+ 86062us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ffe82 00007fc69e0188b9 00007fc69cf2b5d8 00007fc69cfef063 00007fc69cfeae2f 00007fc69cfeb5ed 00007fc69cf9c869 00007fc69659ec44 00007fc69659ebd2
0807 13:39:09.568053 (+ 25263us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":48538368}
I20260807 13:39:09.880198 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8a377464d3c4243989dd0c5f15cd3f1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:09.969832 23575 raft_consensus.cc:3037] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:09.873665 23573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:09.844822 23661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9b09df756c14aa29e17459696a886a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:09.819923 25345 raft_consensus.cc:482] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:09.883150 23574 raft_consensus.cc:2454] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4.
I20260807 13:39:09.826694 23567 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49032 (request call id 86) took 2575 ms. Trace:
I20260807 13:39:09.821375 23565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2a4ce7bb4d64b8596158d5ac194e4a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:09.911671 25155 raft_consensus.cc:482] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:09.912216 23562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49032 (request call id 85) took 3069 ms. Trace:
I20260807 13:39:09.912506 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:09.998282 23572 raft_consensus.cc:3037] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:09.914330 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:09.918515 23458 tablet_service.cc:1467] Processing CreateTablet for tablet 19ee3f9a953c4bbd889fc7001a63fec1 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260807 13:39:09.919938 23563 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49032 (request call id 83) took 3106 ms. Trace:
I20260807 13:39:09.920534 25551 raft_consensus.cc:482] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:09.920637 25578 raft_consensus.cc:482] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:09.921353 25565 raft_consensus.cc:482] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:09.921948 23430 leader_election.cc:302] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:09.922712 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:09.924172 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4da43081a61b4d25bbd028722bd1223c" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:09.924331 25491 raft_consensus.cc:482] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:09.975915 25367 raft_consensus.cc:482] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:39:09.920433 23681 raft_consensus.cc:2454] T 220c24fa0c52459182e1e89c74331f3b P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:39:09.849774 23470 raft_consensus.cc:2454] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 3.
I20260807 13:39:09.937276 23657 rpcz_store.cc:276] 0807 13:39:07.606573 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:09.044542 (+1437969us) service_pool.cc:227] Handling call
0807 13:39:09.129363 (+ 84821us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:09.138121 (+ 8758us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:09.746850 (+608729us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:09.804969 (+ 58119us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:09.811478 (+ 6509us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:09.944666 23571 raft_consensus.cc:2379] T ea167f614ede4fb0b327431be74e98b0 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 4: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:39:09.945005 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613"
I20260807 13:39:09.954860 23533 leader_election.cc:302] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:39:09.848340 25165 raft_consensus.cc:504] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.965157 23582 raft_consensus.cc:2454] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 5.
I20260807 13:39:09.964694 23475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "356c6b3e51454d418acaa9be70bb9689" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:09.850710 25498 raft_consensus.cc:504] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.964593 23465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02cac2e1f00446668f33a2bf5fbbd4de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:10.026854 23679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:09.988533 25345 raft_consensus.cc:3037] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:09.880832 25490 raft_consensus.cc:504] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:09.985085 25528 raft_consensus.cc:482] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:09.750180 25468 rpcz_store.cc:276] 0807 13:39:05.190535 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:05.203723 (+ 13188us) service_pool.cc:227] Handling call
0807 13:39:06.109295 (+905572us) ts_tablet_manager.cc:1145] Deleting tablet 95c5e5bf2dd94ffc98d4ac0c6876c02e
0807 13:39:06.117333 (+ 8038us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 13:39:08.617488 (+2500155us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:09.259756 (+642268us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:09.617872 (+358116us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":471371,"tablet-delete.queue_time_us":783600,"thread_start_us":350943,"threads_started":1}
I20260807 13:39:09.950332 25372 leader_election.cc:288] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:09.947841 25331 raft_consensus.cc:504] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:10.008839 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:10.010107 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
W20260807 13:39:09.925568 25640 log.cc:924] Time spent T 00000000000000000000000000000000 P 24a5f104316e4154b2778270aa891281: Append to log took a long time: real 0.073s user 0.000s sys 0.000s
I20260807 13:39:09.982892 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
W20260807 13:39:10.033999 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 79205.1us
I20260807 13:39:10.071547 23657 tablet_service.cc:1467] Processing CreateTablet for tablet f6cf62903437494c9280c9bf34653cb1 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260807 13:39:10.057260 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 135407us
I20260807 13:39:10.279826 23671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:10.054768 23479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
W20260807 13:39:10.280270 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 509208us
I20260807 13:39:10.334892 23657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6cf62903437494c9280c9bf34653cb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:10.270763 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4996c3c52ccc41b9a8da11ca747a8e6a" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:10.337628 23532 leader_election.cc:302] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:10.339185 23681 raft_consensus.cc:2379] T 4996c3c52ccc41b9a8da11ca747a8e6a P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 in current term 3: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:39:10.333420 23578 raft_consensus.cc:3037] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:39:10.335708 23479 raft_consensus.cc:2454] T 8dc332a3eb6042b1ae81daca421463d1 P e11cad1eeaf5424c94e51241096f6613 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 7.
I20260807 13:39:10.278481 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad4a1bc9b3a24e2da54bcbdc8ae0b14c" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:10.345738 23581 raft_consensus.cc:3037] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:09.940824 23662 rpcz_store.cc:276] 0807 13:39:07.412842 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.415523 (+ 2681us) service_pool.cc:227] Handling call
0807 13:39:08.935507 (+1519984us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:08.935755 (+ 248us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:09.365128 (+429373us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:09.791712 (+426584us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:09.829254 (+ 37542us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:10.170957 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:10.069955 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b23b4f74b0f41e1920fa0a5b83ed1a1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:10.342732 23533 leader_election.cc:302] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:39:10.349334 23480 raft_consensus.cc:2454] T 8cd7bd21d1d04883878a334d64e518e3 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 5.
I20260807 13:39:10.351748 23571 raft_consensus.cc:3037] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:39:10.396351 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 47554.2us
W20260807 13:39:10.325763 23467 consensus_meta.cc:287] T 508c989e13ca4c47b5e2982478c5d328 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.904s user 0.009s sys 0.005s
W20260807 13:39:10.234927 23664 consensus_meta.cc:287] T dd8a99f8a43a4481a51b4d339f14bfdc P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.922s user 0.012s sys 0.000s
I20260807 13:39:10.399603 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:10.071175 25482 raft_consensus.cc:2781] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:39:10.229244 23458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19ee3f9a953c4bbd889fc7001a63fec1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 13:39:10.034915 23564 consensus_meta.cc:287] T 2d4dd3ca60c94d7e891841088eb8f765 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.549s user 0.013s sys 0.009s
I20260807 13:39:10.054061 25556 raft_consensus.cc:2781] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:39:10.367179 25611 raft_consensus.cc:482] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:39:10.430599 23574 raft_consensus.cc:2379] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 4: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:39:10.103619 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b078a19f38494b04ad11b14d98ec4bca" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:10.527830 23582 raft_consensus.cc:2454] T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 1.
I20260807 13:39:10.269479 25557 raft_consensus.cc:482] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:10.002532 25613 raft_consensus.cc:2781] T 8dc332a3eb6042b1ae81daca421463d1 P 9ae273efd33642ad970ab8d1973917c1 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:39:10.445628 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faff067df57c4de49e89824bbc248751" candidate_uuid: "9ae273efd33642ad970ab8d1973917c1" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:10.335520 23671 raft_consensus.cc:2454] T befa4915864b484ebbdf16226fda5bc0 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 4.
I20260807 13:39:10.148705 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622dda6b9b914746953c43538b53bb7e" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:10.399436 23532 leader_election.cc:302] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:10.445360 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce381b59fcae417a87681d73e12ca9ea" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:10.537617 23681 raft_consensus.cc:2454] T faff067df57c4de49e89824bbc248751 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 2.
I20260807 13:39:10.451390 25490 leader_election.cc:288] T bc264e3efe7340e4a63da01f78c1f136 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:10.027843 25491 raft_consensus.cc:504] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:10.027179 25565 raft_consensus.cc:504] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:10.452764 23430 leader_election.cc:302] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:10.569962 23581 raft_consensus.cc:2454] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 5.
I20260807 13:39:10.570272 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befa4915864b484ebbdf16226fda5bc0" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:10.571115 23582 raft_consensus.cc:2454] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4.
I20260807 13:39:10.571353 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d8b8a0a0e1f4c39b49a8113f26cb278" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:10.016288 25155 raft_consensus.cc:504] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:10.453207 25482 raft_consensus.cc:482] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:39:10.215152 25301 consensus_meta.cc:287] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.608s user 0.010s sys 0.010s
I20260807 13:39:10.342185 25528 raft_consensus.cc:504] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:10.460328 25522 raft_consensus.cc:2229] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 3 LEADER]: Raft consensus shutting down.
I20260807 13:39:10.461756 25306 consensus_queue.cc:1035] T faff067df57c4de49e89824bbc248751 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260807 13:39:10.462569 25377 consensus_meta.cc:287] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 1.014s user 0.009s sys 0.000s
I20260807 13:39:10.463368 25165 leader_election.cc:288] T 220c24fa0c52459182e1e89c74331f3b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:10.464788 23677 raft_consensus.cc:3032] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:39:10.445047 25311 leader_election.cc:288] T 0e601359a84745c38ae821025d18d881 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:10.469049 23575 raft_consensus.cc:2454] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 5.
I20260807 13:39:10.339418 25287 raft_consensus.cc:504] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:10.470863 23577 raft_consensus.cc:2379] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 6: Already voted for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in this term.
I20260807 13:39:10.472098 23662 tablet_service.cc:1467] Processing CreateTablet for tablet 1bef6ef007eb4dd18759fb406e70535c (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260807 13:39:10.472692 25331 leader_election.cc:288] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:10.474931 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc264e3efe7340e4a63da01f78c1f136" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:10.476116 23326 catalog_manager.cc:4841] TS 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): tablet 95c5e5bf2dd94ffc98d4ac0c6876c02e (table test-workload [id=6c3159b450c749628fd57db2251c593c]) successfully deleted
W20260807 13:39:10.245729 25642 log.cc:924] Time spent T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.059s user 0.000s sys 0.000s
I20260807 13:39:09.986164 23567 rpcz_store.cc:276] 0807 13:39:07.242347 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:08.121567 (+879220us) service_pool.cc:227] Handling call
0807 13:39:08.285316 (+163749us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:08.299474 (+ 14158us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:09.434845 (+1135371us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:09.717750 (+282905us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:09.817719 (+ 99969us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5522}
I20260807 13:39:09.998078 23562 rpcz_store.cc:276] 0807 13:39:06.842738 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.845936 (+ 3198us) service_pool.cc:227] Handling call
0807 13:39:07.606843 (+760907us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:07.607088 (+ 245us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:09.608369 (+2001281us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:09.911528 (+303159us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:09.912146 (+ 618us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":45824}
I20260807 13:39:10.016389 25551 raft_consensus.cc:504] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:10.289045 23663 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57108 (request call id 81) took 2877 ms. Trace:
I20260807 13:39:10.480301 25498 leader_election.cc:288] T 7cd369f3fbdf4b61a5fd1e85690c9ba4 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:10.481869 25628 leader_election.cc:288] T b6646e8113874345a9835c8fce2e0c51 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:10.275838 23670 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57108 (request call id 76) took 3826 ms. Trace:
I20260807 13:39:10.495980 23572 raft_consensus.cc:2454] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 5.
I20260807 13:39:10.501206 23456 tablet_service.cc:1467] Processing CreateTablet for tablet 1bef6ef007eb4dd18759fb406e70535c (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260807 13:39:10.103353 25322 raft_consensus.cc:482] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:39:10.515982 23633 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.545s user 0.016s sys 0.020s
I20260807 13:39:10.330111 25361 raft_consensus.cc:482] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e11cad1eeaf5424c94e51241096f6613)
I20260807 13:39:10.020809 25578 raft_consensus.cc:504] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:10.499399 23571 raft_consensus.cc:2454] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
W20260807 13:39:10.412591 23407 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:39:10.260778 25608 leader_election.cc:288] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:10.234730 25273 leader_election.cc:288] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765), e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037)
I20260807 13:39:10.517964 23661 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57108 (request call id 87) took 2912 ms. Trace:
I20260807 13:39:10.399951 25442 raft_consensus.cc:2726] T 9adcbc4da68046a08d0694c794088162 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:10.272910 23675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57122 (request call id 591) took 1237 ms. Trace:
I20260807 13:39:10.542562 23566 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49032 (request call id 91) took 2967 ms. Trace:
I20260807 13:39:10.566413 23565 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49032 (request call id 92) took 2867 ms. Trace:
I20260807 13:39:10.566941 23462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9b09df756c14aa29e17459696a886a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:10.034484 25367 raft_consensus.cc:504] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:10.576551 23581 raft_consensus.cc:2379] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 4: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:39:10.576684 23574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4996c3c52ccc41b9a8da11ca747a8e6a" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1"
I20260807 13:39:10.000368 23563 rpcz_store.cc:276] 0807 13:39:06.813997 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.816852 (+ 2855us) service_pool.cc:227] Handling call
0807 13:39:07.608573 (+791721us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:07.608826 (+ 253us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:09.429291 (+1820465us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:09.913706 (+484415us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:09.919830 (+ 6124us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:10.517644 25556 raft_consensus.cc:482] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:10.519815 25372 raft_consensus.cc:482] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:10.597306 23684 raft_consensus.cc:1261] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260807 13:39:10.604275 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c074cd105794bf1a00bd3a9f449a323" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:10.766324 23684 pending_rounds.cc:76] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Aborting all ops after (but not including) 2
I20260807 13:39:10.766625 23684 pending_rounds.cc:97] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260807 13:39:10.766880 23684 raft_consensus.cc:2866] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:39:10.537611 25611 raft_consensus.cc:504] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:10.602706 23677 raft_consensus.cc:729] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e0ea5aa0c6d4846a5ccc9962342e17a, State: Running, Role: LEADER
I20260807 13:39:10.583829 25482 raft_consensus.cc:3037] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:10.597702 25301 raft_consensus.cc:2781] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:39:10.605844 23679 raft_consensus.cc:2454] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ae273efd33642ad970ab8d1973917c1 in term 5.
I20260807 13:39:10.429651 23659 tablet_service.cc:1467] Processing CreateTablet for tablet 19ee3f9a953c4bbd889fc7001a63fec1 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260807 13:39:10.614225 23575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:39:10.616966 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 164288us
I20260807 13:39:10.753217 23662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1bef6ef007eb4dd18759fb406e70535c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:10.788321 23657 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57108 (request call id 88) took 3182 ms. Trace:
W20260807 13:39:10.621909 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 279282us
I20260807 13:39:10.616724 23664 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57108 (request call id 80) took 3207 ms. Trace:
I20260807 13:39:10.766724 25556 raft_consensus.cc:3037] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:10.665158 25522 raft_consensus.cc:2258] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:39:10.757015 25602 tablet_bootstrap.cc:492] T 0d7a01108a7042148334c054995cba3b P e11cad1eeaf5424c94e51241096f6613: No bootstrap required, opened a new log
I20260807 13:39:10.757455 25287 leader_election.cc:288] T c5654668ae6a4a729bda462319d04c5f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:10.804881 25287 consensus_queue.cc:1035] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260807 13:39:10.759394 25428 consensus_meta.cc:287] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 1.148s user 0.005s sys 0.006s
I20260807 13:39:10.810848 25428 raft_consensus.cc:482] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:10.811172 23676 raft_consensus.cc:2396] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ae273efd33642ad970ab8d1973917c1 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260807 13:39:10.625504 23326 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 149451us
I20260807 13:39:10.811806 25597 tablet_bootstrap.cc:654] T 566a7784d04c469483a0a06b376eb089 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Neither blocks nor log segments found. Creating new log.
I20260807 13:39:10.811436 25428 raft_consensus.cc:504] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:10.763054 25565 leader_election.cc:288] T d36f9c3051e24fba90a7a4418204d381 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:10.603153 25377 raft_consensus.cc:504] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:10.614271 25165 raft_consensus.cc:2781] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:39:10.626672 23481 raft_consensus.cc:1226] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 3. Current term is 4. Ops: []
I20260807 13:39:10.768273 23565 rpcz_store.cc:276] 0807 13:39:07.671227 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:09.740209 (+2068982us) service_pool.cc:227] Handling call
0807 13:39:09.773765 (+ 33556us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:09.773863 (+ 98us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:10.009167 (+235304us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:10.531703 (+522536us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:10.538369 (+ 6666us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1908}
I20260807 13:39:10.769677 23661 rpcz_store.cc:276] 0807 13:39:07.605849 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:09.842248 (+2236399us) service_pool.cc:227] Handling call
0807 13:39:09.844275 (+ 2027us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:09.844380 (+ 105us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:10.346386 (+502006us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:10.494867 (+148481us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:10.517881 (+ 23014us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10083}
I20260807 13:39:10.771975 23574 raft_consensus.cc:3037] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:39:10.775895 23633 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.805s user 0.023s sys 0.028s
I20260807 13:39:10.783730 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdef01e85a44e1093dd335055986423" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:10.828013 23571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 562) took 1069 ms. Trace:
I20260807 13:39:10.828447 23571 rpcz_store.cc:276] 0807 13:39:09.759037 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:10.783415 (+1024378us) service_pool.cc:227] Handling call
0807 13:39:10.827934 (+ 44519us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:10.785351 23430 leader_election.cc:302] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:10.496608 23578 raft_consensus.cc:2454] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 6.
I20260807 13:39:10.769055 23566 rpcz_store.cc:276] 0807 13:39:07.575531 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:09.486359 (+1910828us) service_pool.cc:227] Handling call
0807 13:39:09.549644 (+ 63285us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:09.559419 (+ 9775us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:10.510798 (+951379us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:10.541890 (+ 31092us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:10.542480 (+ 590us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:10.623420 25579 tablet_bootstrap.cc:492] T 0d7a01108a7042148334c054995cba3b P 9ae273efd33642ad970ab8d1973917c1: No bootstrap required, opened a new log
I20260807 13:39:10.830844 23631 leader_election.cc:302] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613; no voters:
I20260807 13:39:10.625088 23573 raft_consensus.cc:2379] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 4: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:39:10.561854 25557 raft_consensus.cc:504] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:10.788556 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 389203us
W20260807 13:39:10.704967 23570 consensus_meta.cc:287] T 23e06eb23c7549ca833574823dc2f8a1 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 1.109s user 0.010s sys 0.002s
I20260807 13:39:10.790072 23582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05a3da79d3b0447cbc19c4f28279e134" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:39:10.615386 25345 consensus_meta.cc:287] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.511s user 0.007s sys 0.003s
I20260807 13:39:10.621645 25331 raft_consensus.cc:2726] T 28395e0788e4418291f95845e9d5e793 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:10.789929 23657 rpcz_store.cc:276] 0807 13:39:07.606224 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:10.024131 (+2417907us) service_pool.cc:227] Handling call
0807 13:39:10.334428 (+310297us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:10.334523 (+ 95us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:10.587331 (+252808us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:10.776773 (+189442us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:10.788238 (+ 11465us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:10.624923 23572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "356c6b3e51454d418acaa9be70bb9689" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:39:10.774390 25526 consensus_meta.cc:287] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.793s user 0.008s sys 0.003s
I20260807 13:39:10.621922 23564 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49032 (request call id 84) took 3803 ms. Trace:
I20260807 13:39:10.791567 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc332a3eb6042b1ae81daca421463d1" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:10.754420 25551 leader_election.cc:288] T 647de9e979b94eddb7556f6737c7358b P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
W20260807 13:39:10.850636 23478 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.745s user 0.013s sys 0.030s
I20260807 13:39:10.773114 25372 raft_consensus.cc:504] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:10.791215 25654 raft_consensus.cc:482] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:10.802749 25155 leader_election.cc:288] T c5654668ae6a4a729bda462319d04c5f P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:10.802971 23460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d4dd3ca60c94d7e891841088eb8f765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:10.752813 25528 leader_election.cc:288] T b4fca61b91424248bc334d15fc11f82d P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:10.803306 25602 ts_tablet_manager.cc:1397] T 0d7a01108a7042148334c054995cba3b P e11cad1eeaf5424c94e51241096f6613: Time spent bootstrapping tablet: real 1.801s user 0.064s sys 0.098s
I20260807 13:39:10.783159 25301 raft_consensus.cc:482] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:10.823160 23684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e601359a84745c38ae821025d18d881" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" is_pre_election: true
I20260807 13:39:10.802824 25471 ts_tablet_manager.cc:1918] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 4.2
I20260807 13:39:10.850751 25345 raft_consensus.cc:504] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:10.883996 25471 log.cc:1196] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Deleting WAL directory at /tmp/dist-test-taskcxB6if/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109844500879-21780-0/minicluster-data/ts-2-root/wals/fcdef01e85a44e1093dd335055986423
I20260807 13:39:10.837680 23661 tablet_service.cc:1467] Processing CreateTablet for tablet e2a4ce7bb4d64b8596158d5ac194e4a9 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260807 13:39:10.798889 25491 leader_election.cc:288] T 39707c5d97164544b9f5c03db41181c0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:10.839795 25578 leader_election.cc:288] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:10.839675 25526 raft_consensus.cc:504] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:10.824939 25165 raft_consensus.cc:482] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:10.840927 25367 leader_election.cc:288] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
W20260807 13:39:10.841691 25648 log.cc:924] Time spent T a523d2840d4a4565b8051820b04b147f P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.235s user 0.000s sys 0.000s
I20260807 13:39:10.841780 23570 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49032 (request call id 81) took 4033 ms. Trace:
I20260807 13:39:10.904036 23570 rpcz_store.cc:276] 0807 13:39:06.808340 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.813910 (+ 5570us) service_pool.cc:227] Handling call
0807 13:39:07.609969 (+796059us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:07.610188 (+ 219us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:09.595286 (+1985098us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:10.841123 (+1245837us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:10.841704 (+ 581us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:10.842204 23564 rpcz_store.cc:276] 0807 13:39:06.818195 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.822072 (+ 3877us) service_pool.cc:227] Handling call
0807 13:39:07.606569 (+784497us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b58000af898. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ffb7c 00007fc6950ff73b 00007fc69dfefb09 00007fc69cf2b730 00007fc69d00dd21 00007fc69cfeb1e3 00007fc69cf9c869 00007fc69659ec44 00007fc69659ebd2 00007fc69659eb01
0807 13:39:07.611584 (+ 5015us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:07.611797 (+ 213us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:09.468433 (+1856636us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:10.561868 (+1093435us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:10.619142 (+ 57274us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6084480}
I20260807 13:39:10.843955 25311 raft_consensus.cc:482] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:10.844462 25579 ts_tablet_manager.cc:1397] T 0d7a01108a7042148334c054995cba3b P 9ae273efd33642ad970ab8d1973917c1: Time spent bootstrapping tablet: real 2.262s user 0.018s sys 0.038s
I20260807 13:39:10.844738 25557 leader_election.cc:288] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:10.791019 23664 rpcz_store.cc:276] 0807 13:39:07.406713 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.418945 (+ 12232us) service_pool.cc:227] Handling call
0807 13:39:07.647265 (+228320us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:07.647603 (+ 338us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:09.223627 (+1576024us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:10.531543 (+1307916us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:10.613326 (+ 81783us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:10.845969 23659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19ee3f9a953c4bbd889fc7001a63fec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:10.846176 23532 leader_election.cc:302] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:10.846974 25428 leader_election.cc:288] T 5164c8847c724b03bb6c8d0ba41d9535 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:10.621212 23670 rpcz_store.cc:276] 0807 13:39:06.449152 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.449283 (+ 131us) service_pool.cc:227] Handling call
0807 13:39:06.485578 (+ 36295us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:06.485695 (+ 117us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:09.039968 (+2554273us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:09.542789 (+502821us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:10.275300 (+732511us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b5800004298. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ffe82 00007fc69e0188b9 00007fc69cf2b5d8 00007fc69cfef063 00007fc69cfeae2f 00007fc69cfeb5ed 00007fc69cf9c869 00007fc69659ec44 00007fc69659ebd2
0807 13:39:10.275758 (+ 458us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8659328}
I20260807 13:39:10.847577 23572 raft_consensus.cc:1261] T ea6c8df560094315891e2805f0b21791 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Refusing update from remote peer e11cad1eeaf5424c94e51241096f6613: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260807 13:39:10.783715 25361 raft_consensus.cc:504] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:10.781728 25322 raft_consensus.cc:504] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:10.848110 25662 consensus_queue.cc:1035] T a2d9eca137dd4e03bdcaa721491ef3c0 P 9ae273efd33642ad970ab8d1973917c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:39:10.849047 25377 leader_election.cc:288] T f846254307f64297ae642172f37ab394 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:10.776199 23675 rpcz_store.cc:276] 0807 13:39:09.035019 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:09.130726 (+ 95707us) service_pool.cc:227] Handling call
0807 13:39:09.202810 (+ 72084us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:09.874435 (+671625us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:09.879292 (+ 4857us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:09.902557 (+ 23265us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:39:09.929160 (+ 26603us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:10.272525 (+343365us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b5400041854. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc69805ff51 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc 00007fc696685772 00007fc69648994c 00007fc696488d86
0807 13:39:10.272603 (+ 78us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:10.272813 (+ 210us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":93275,"raft.queue_time_us":2968,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":9520,"spinlock_wait_cycles":1294912896}
I20260807 13:39:10.793430 23677 consensus_queue.cc:260] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:10.855876 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 70611.1us
W20260807 13:39:10.851226 23478 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.746s user 0.014s sys 0.030s
I20260807 13:39:10.860775 23533 leader_election.cc:302] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:39:10.618397 23663 rpcz_store.cc:276] 0807 13:39:07.411694 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:07.418237 (+ 6543us) service_pool.cc:227] Handling call
0807 13:39:08.942954 (+1524717us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:08.972197 (+ 29243us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:09.585682 (+613485us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:10.122838 (+537156us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:10.264945 (+142107us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2432}
I20260807 13:39:10.862306 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70dd63c6fc214c5882dd73c5f05fad72" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:10.941325 23571 raft_consensus.cc:2379] T 70dd63c6fc214c5882dd73c5f05fad72 P 9ae273efd33642ad970ab8d1973917c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 7: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:39:10.941859 23571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 564) took 1171 ms. Trace:
I20260807 13:39:10.942245 23571 rpcz_store.cc:276] 0807 13:39:09.770392 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:10.829407 (+1059015us) service_pool.cc:227] Handling call
0807 13:39:10.941789 (+112382us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:10.873060 23672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5654668ae6a4a729bda462319d04c5f" candidate_uuid: "e11cad1eeaf5424c94e51241096f6613" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a"
I20260807 13:39:10.850363 25565 raft_consensus.cc:2726] T ae09b72e43be4ee7a4c56900f3f31fdb P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:39:10.876444 23581 raft_consensus.cc:1226] T 2b1542e790794928a76e4b29a1d7732b P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260807 13:39:10.879596 25301 raft_consensus.cc:3037] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Advancing to term 7
W20260807 13:39:10.879856 23561 consensus_meta.cc:287] T dd8a99f8a43a4481a51b4d339f14bfdc P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 1.151s user 0.005s sys 0.012s
I20260807 13:39:10.959113 23677 raft_consensus.cc:3037] T d36f9c3051e24fba90a7a4418204d381 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:10.873796 25654 raft_consensus.cc:504] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:10.885372 23577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 554) took 1128 ms. Trace:
I20260807 13:39:10.964107 23577 rpcz_store.cc:276] 0807 13:39:09.756480 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:09.769768 (+ 13288us) service_pool.cc:227] Handling call
0807 13:39:10.885163 (+1115395us) spinlock_profiling.cc:243] Waited 669 ms on lock 0x7b540030bbd4. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc6980632ae 00007fc69cfa0c27 00007fc696688c04 00007fc696688b92 00007fc696688ac1 00007fc696688a3c 00007fc696687cf2 00007fc69648994c 00007fc696488d86 00007fc69648872f
0807 13:39:10.885305 (+ 142us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1539405184}
I20260807 13:39:10.893254 23580 raft_consensus.cc:2454] T bc264e3efe7340e4a63da01f78c1f136 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 5.
I20260807 13:39:10.965353 23580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49040 (request call id 536) took 1323 ms. Trace:
I20260807 13:39:10.965685 23580 rpcz_store.cc:276] 0807 13:39:09.642007 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:10.366818 (+724811us) service_pool.cc:227] Handling call
0807 13:39:10.965281 (+598463us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:10.967334 23661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2a4ce7bb4d64b8596158d5ac194e4a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:39:10.968405 23430 leader_election.cc:302] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:10.898705 25675 raft_consensus.cc:2781] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260807 13:39:10.901201 23429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 113274us
I20260807 13:39:10.900815 25165 raft_consensus.cc:3037] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:10.904915 23680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 672) took 1309 ms. Trace:
I20260807 13:39:10.891113 25667 raft_consensus.cc:482] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:10.934872 25471 ts_tablet_manager.cc:1939] T fcdef01e85a44e1093dd335055986423 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Deleting consensus metadata
I20260807 13:39:10.822467 25556 raft_consensus.cc:504] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:10.949148 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 103052us
W20260807 13:39:10.880626 25570 consensus_meta.cc:287] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 1.267s user 0.010s sys 0.008s
W20260807 13:39:10.959785 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 99952.6us
I20260807 13:39:10.971326 23580 raft_consensus.cc:1226] T c8a377464d3c4243989dd0c5f15cd3f1 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 4. Current term is 5. Ops: []
I20260807 13:39:10.969378 23680 rpcz_store.cc:276] 0807 13:39:09.595474 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:09.749860 (+154386us) service_pool.cc:227] Handling call
0807 13:39:09.792343 (+ 42483us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:09.873320 (+ 80977us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:09.873349 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:09.873833 (+ 484us) log.cc:842] Serialized 26 byte log entry
0807 13:39:10.020042 (+146209us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:10.020186 (+ 144us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:10.020426 (+ 240us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:10.904690 (+884264us) raft_consensus.cc:1671] finished
0807 13:39:10.904710 (+ 20us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:10.904853 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":88393,"raft.queue_time_us":76795,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":32512,"thread_start_us":145522,"threads_started":1,"wal-append.queue_time_us":652960}
I20260807 13:39:10.996506 23581 raft_consensus.cc:1226] T 8cd7bd21d1d04883878a334d64e518e3 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 4. Current term is 5. Ops: []
I20260807 13:39:10.998376 23430 leader_election.cc:302] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:10.998795 23533 leader_election.cc:302] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
I20260807 13:39:10.948589 25428 raft_consensus.cc:482] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:11.006803 23533 leader_election.cc:302] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1; no voters:
W20260807 13:39:11.014199 23631 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 189438us
I20260807 13:39:10.923488 25311 raft_consensus.cc:504] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:10.972056 25155 raft_consensus.cc:2781] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:39:10.976595 25675 raft_consensus.cc:482] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:10.981067 25565 raft_consensus.cc:2781] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260807 13:39:11.006100 25619 consensus_meta.cc:287] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 1.138s user 0.014s sys 0.000s
I20260807 13:39:10.978389 25611 leader_election.cc:288] T 9adcbc4da68046a08d0694c794088162 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:10.980876 25570 raft_consensus.cc:504] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:10.978489 25667 raft_consensus.cc:504] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:11.042646 23581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:11.071427 23571 raft_consensus.cc:1226] T ce381b59fcae417a87681d73e12ca9ea P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 3. Current term is 4. Ops: []
I20260807 13:39:11.043761 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
W20260807 13:39:11.227784 23430 leader_election.cc:341] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363): Illegal state: Tablet not RUNNING: STOPPED
I20260807 13:39:11.217248 23574 raft_consensus.cc:2454] T 4996c3c52ccc41b9a8da11ca747a8e6a P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:39:11.228490 23430 leader_election.cc:302] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:11.228695 23574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49034 (request call id 565) took 1435 ms. Trace:
W20260807 13:39:11.090082 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 72460.6us
I20260807 13:39:11.229279 23574 rpcz_store.cc:276] 0807 13:39:09.793407 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:10.561704 (+768297us) service_pool.cc:227] Handling call
0807 13:39:11.228611 (+666907us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:11.231292 23532 leader_election.cc:302] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:11.022779 25442 raft_consensus.cc:2781] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:39:11.309209 25442 raft_consensus.cc:482] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:11.309774 25442 raft_consensus.cc:3037] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:11.302186 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:11.024719 25608 raft_consensus.cc:2781] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260807 13:39:11.127519 23324 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 85107.1us
I20260807 13:39:11.314385 25608 raft_consensus.cc:482] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:39:11.314815 25608 raft_consensus.cc:3037] T befa4915864b484ebbdf16226fda5bc0 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Advancing to term 5
W20260807 13:39:11.284557 23430 raft_consensus.cc:2670] T 95c5e5bf2dd94ffc98d4ac0c6876c02e P e11cad1eeaf5424c94e51241096f6613: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260807 13:39:11.108974 25377 consensus_queue.cc:1225] T 2b1542e790794928a76e4b29a1d7732b P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Peer 5e0ea5aa0c6d4846a5ccc9962342e17a log is divergent from this leader: its last log entry 1.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260807 13:39:11.043520 25675 raft_consensus.cc:3037] T 8dc332a3eb6042b1ae81daca421463d1 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:39:11.326228 25442 raft_consensus.cc:504] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:11.318557 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 90838.2us
I20260807 13:39:11.329361 23430 leader_election.cc:302] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:11.330742 23430 leader_election.cc:302] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:11.331610 25326 raft_consensus.cc:2726] T d1bcab9bf8fc4a508a914326892a42a9 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:39:11.331992 25311 leader_election.cc:288] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:11.332297 25326 raft_consensus.cc:2726] T 356c6b3e51454d418acaa9be70bb9689 P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:39:11.332628 25556 leader_election.cc:288] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:11.333128 25667 leader_election.cc:288] T 70dd63c6fc214c5882dd73c5f05fad72 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:11.128569 25598 consensus_queue.cc:1046] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P 5e0ea5aa0c6d4846a5ccc9962342e17a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.205s
I20260807 13:39:11.127508 25345 leader_election.cc:288] T ea6ae70649fa43bba8052b66977418f5 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:11.334544 25602 raft_consensus.cc:348] T 0d7a01108a7042148334c054995cba3b P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } }
I20260807 13:39:11.335323 25602 raft_consensus.cc:374] T 0d7a01108a7042148334c054995cba3b P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:11.335966 25522 ts_tablet_manager.cc:1905] T e20c3c18eb474ef5b19f3300b13b17c3 P 9ae273efd33642ad970ab8d1973917c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 13:39:11.335333 23468 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33966 (request call id 85) took 2211 ms. Trace:
I20260807 13:39:11.335880 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d9eca137dd4e03bdcaa721491ef3c0" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:11.337038 23480 raft_consensus.cc:2454] T a2d9eca137dd4e03bdcaa721491ef3c0 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 5.
I20260807 13:39:11.336694 23468 rpcz_store.cc:276] 0807 13:39:09.123605 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:09.166997 (+ 43392us) service_pool.cc:227] Handling call
0807 13:39:09.442901 (+275904us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:09.443044 (+ 143us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:09.734086 (+291042us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:09.996685 (+262599us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:11.334913 (+1338228us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b5800003398. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950fffee 00007fc69e0188f9 00007fc69cf2b6a1 00007fc69cfef20b 00007fc69cfeae2f 00007fc69cfeb5ed 00007fc69cf9c869 00007fc69659ec44 00007fc69659ebd2
0807 13:39:11.335270 (+ 357us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":561405312}
W20260807 13:39:11.337604 23480 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 533) took 1213 ms (client timeout 1563 ms). Trace:
W20260807 13:39:11.337950 23480 rpcz_store.cc:269] 0807 13:39:10.124619 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:10.396497 (+271878us) service_pool.cc:227] Handling call
0807 13:39:11.337543 (+941046us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:39:11.338264 25186 consensus_meta.cc:287] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 1.465s user 0.009s sys 0.006s
I20260807 13:39:11.338959 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e20c3c18eb474ef5b19f3300b13b17c3" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:11.339067 23468 tablet_service.cc:1467] Processing CreateTablet for tablet e2a4ce7bb4d64b8596158d5ac194e4a9 (DEFAULT_TABLE table=test-workload [id=6c3159b450c749628fd57db2251c593c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260807 13:39:11.335880 23472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 528) took 1355 ms. Trace:
I20260807 13:39:11.340540 25361 leader_election.cc:288] T 3d67ad93011c4a87b0ede6554a1608ce P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:11.340121 23472 rpcz_store.cc:276] 0807 13:39:09.980149 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:09.998742 (+ 18593us) service_pool.cc:227] Handling call
0807 13:39:11.335253 (+1336511us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:11.335488 (+ 235us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:11.335517 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:11.335568 (+ 51us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:39:11.335598 (+ 30us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:11.335679 (+ 81us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:11.335812 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:11.342198 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:11.343302 23472 raft_consensus.cc:2379] T b4fca61b91424248bc334d15fc11f82d P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 6: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:39:11.344106 25654 leader_election.cc:288] T b6646e8113874345a9835c8fce2e0c51 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:11.344456 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:11.339553 23480 raft_consensus.cc:2454] T e20c3c18eb474ef5b19f3300b13b17c3 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 3.
I20260807 13:39:11.345923 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9adcbc4da68046a08d0694c794088162" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:11.347316 23480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:11.192890 25372 leader_election.cc:288] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:11.349229 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eba6f59d7f4541873d69ef88a0ad93" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:11.350024 23472 raft_consensus.cc:2454] T 11eba6f59d7f4541873d69ef88a0ad93 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 5.
I20260807 13:39:11.352384 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4fca61b91424248bc334d15fc11f82d" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:11.352947 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 534) took 1137 ms. Trace:
I20260807 13:39:11.353202 23580 raft_consensus.cc:2379] T b4fca61b91424248bc334d15fc11f82d P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in current term 6: Already voted for candidate e11cad1eeaf5424c94e51241096f6613 in this term.
I20260807 13:39:11.353391 23480 rpcz_store.cc:276] 0807 13:39:10.215295 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:11.351870 (+1136575us) service_pool.cc:227] Handling call
0807 13:39:11.352247 (+ 377us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:11.352493 (+ 246us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:11.352528 (+ 35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:11.352577 (+ 49us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:39:11.352618 (+ 41us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:11.352684 (+ 66us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:11.352873 (+ 189us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:39:11.354182 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5164c8847c724b03bb6c8d0ba41d9535" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:11.032696 25155 raft_consensus.cc:482] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:11.354807 23580 raft_consensus.cc:2454] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 5.
I20260807 13:39:11.355042 25155 raft_consensus.cc:3037] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:11.351303 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d67ad93011c4a87b0ede6554a1608ce" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:11.335999 23469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "944b1327a944412b8ef8b5a60f96fb2d" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e11cad1eeaf5424c94e51241096f6613" is_pre_election: true
I20260807 13:39:11.357817 23684 raft_consensus.cc:2454] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 3.
I20260807 13:39:11.034363 25671 raft_consensus.cc:2781] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:39:11.361691 23672 raft_consensus.cc:2454] T c5654668ae6a4a729bda462319d04c5f P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11cad1eeaf5424c94e51241096f6613 in term 4.
I20260807 13:39:11.358089 23469 raft_consensus.cc:2454] T 944b1327a944412b8ef8b5a60f96fb2d P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 6.
I20260807 13:39:11.363888 23469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33986 (request call id 529) took 1367 ms. Trace:
I20260807 13:39:11.364250 23469 rpcz_store.cc:276] 0807 13:39:09.996994 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:10.075795 (+ 78801us) service_pool.cc:227] Handling call
0807 13:39:10.758752 (+682957us) spinlock_profiling.cc:243] Waited 9.57 ms on lock 0x7b5800003398. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc694f7bf11 00007fc6950ff851 00007fc6950ff702 00007fc69dfefb09 00007fc69cf2b730 00007fc69cff179b 00007fc69cff1821 00007fc69cfa11b0 00007fc69cfa0a94 00007fc696688c04 00007fc696688b92
0807 13:39:11.363832 (+605080us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":22005120}
I20260807 13:39:11.366465 23473 raft_consensus.cc:1226] T a523d2840d4a4565b8051820b04b147f P e11cad1eeaf5424c94e51241096f6613 [term 6 FOLLOWER]: Rejecting Update request from peer 9ae273efd33642ad970ab8d1973917c1 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260807 13:39:11.212610 25526 leader_election.cc:288] T befa4915864b484ebbdf16226fda5bc0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:11.226593 25628 raft_consensus.cc:482] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
W20260807 13:39:11.373967 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 142755us
I20260807 13:39:11.374601 23581 raft_consensus.cc:1226] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3. Ops: []
I20260807 13:39:11.094869 25619 raft_consensus.cc:482] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:11.374996 23532 leader_election.cc:302] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
W20260807 13:39:11.376147 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 45492.5us
I20260807 13:39:11.357197 23479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 532) took 1324 ms. Trace:
I20260807 13:39:11.381763 23479 rpcz_store.cc:276] 0807 13:39:10.032874 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:10.354649 (+321775us) service_pool.cc:227] Handling call
0807 13:39:11.357130 (+1002481us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:39:11.361296 23465 consensus_meta.cc:287] T 02cac2e1f00446668f33a2bf5fbbd4de P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.536s user 0.007s sys 0.001s
I20260807 13:39:11.025043 25428 raft_consensus.cc:504] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:11.380681 23430 leader_election.cc:302] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:11.386562 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a08c7e6c1b31456ea804d5ecdf2a5b70" candidate_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9ae273efd33642ad970ab8d1973917c1" is_pre_election: true
I20260807 13:39:11.392602 23581 raft_consensus.cc:1226] T 4da43081a61b4d25bbd028722bd1223c P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 4. Current term is 5. Ops: []
I20260807 13:39:11.389160 23580 raft_consensus.cc:2454] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0ea5aa0c6d4846a5ccc9962342e17a in term 4.
I20260807 13:39:11.365443 25671 raft_consensus.cc:482] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:11.335632 25602 raft_consensus.cc:729] T 0d7a01108a7042148334c054995cba3b P e11cad1eeaf5424c94e51241096f6613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Initialized, Role: FOLLOWER
W20260807 13:39:11.398880 23633 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 422607us
W20260807 13:39:11.103673 23326 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 108162us
I20260807 13:39:11.377859 23561 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49032 (request call id 80) took 4561 ms. Trace:
I20260807 13:39:11.406824 23430 leader_election.cc:302] T 8b6d649ae21a41c9b6723944d7036688 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:11.377801 25322 leader_election.cc:288] T 11eba6f59d7f4541873d69ef88a0ad93 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:11.409797 23479 raft_consensus.cc:1226] T 98d96e350af14393a80eeb2702230747 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 3. Current term is 4. Ops: []
I20260807 13:39:11.232916 25565 raft_consensus.cc:482] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:11.391601 25526 raft_consensus.cc:2726] T 4c074cd105794bf1a00bd3a9f449a323 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:11.424230 25442 leader_election.cc:288] T faff067df57c4de49e89824bbc248751 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:11.422736 23430 leader_election.cc:302] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:11.426586 23581 raft_consensus.cc:1261] T 448ac0b9f0f0494cbeb234299ad5cc22 P 9ae273efd33642ad970ab8d1973917c1 [term 6 FOLLOWER]: Refusing update from remote peer 5e0ea5aa0c6d4846a5ccc9962342e17a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260807 13:39:11.423116 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 48245.1us
I20260807 13:39:11.431591 23532 leader_election.cc:302] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:11.382369 25628 raft_consensus.cc:504] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:11.387705 25619 raft_consensus.cc:504] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:11.405336 25671 raft_consensus.cc:3037] T b9fcdd060ef64874a8719c95b2325942 P e11cad1eeaf5424c94e51241096f6613 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:39:11.438000 23472 raft_consensus.cc:1226] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 2. Current term is 3. Ops: []
I20260807 13:39:11.425410 25331 raft_consensus.cc:3037] T 647de9e979b94eddb7556f6737c7358b P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:11.440932 23633 leader_election.cc:302] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0ea5aa0c6d4846a5ccc9962342e17a; no voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:11.453698 25628 leader_election.cc:288] T 98d96e350af14393a80eeb2702230747 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:11.436506 25602 consensus_queue.cc:260] T 0d7a01108a7042148334c054995cba3b P e11cad1eeaf5424c94e51241096f6613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } }
I20260807 13:39:11.458670 25602 ts_tablet_manager.cc:1428] T 0d7a01108a7042148334c054995cba3b P e11cad1eeaf5424c94e51241096f6613: Time spent starting tablet: real 0.566s user 0.004s sys 0.005s
W20260807 13:39:11.459020 25602 ts_tablet_manager.cc:1460] T 0d7a01108a7042148334c054995cba3b P e11cad1eeaf5424c94e51241096f6613: Tablet startup took 572ms
I20260807 13:39:11.510417 23472 raft_consensus.cc:1226] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Rejecting Update request from peer 5e0ea5aa0c6d4846a5ccc9962342e17a for earlier term 4. Current term is 5. Ops: []
I20260807 13:39:11.430197 25377 raft_consensus.cc:2726] T 28395e0788e4418291f95845e9d5e793 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:11.071269 25482 raft_consensus.cc:504] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:11.397068 25301 raft_consensus.cc:504] T f7572ca9ba3b47978ecbc11a3ed09244 P 9ae273efd33642ad970ab8d1973917c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:11.514817 23430 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.2:33363, user_credentials={real_user=slave}} blocked reactor thread for 76099.2us
I20260807 13:39:11.420800 25565 raft_consensus.cc:3037] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:11.515054 23578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49034 (request call id 559) took 1756 ms. Trace:
I20260807 13:39:11.521966 23430 leader_election.cc:302] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
W20260807 13:39:11.524595 23532 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 93116.7us
I20260807 13:39:11.525225 23430 leader_election.cc:302] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:11.526214 23430 leader_election.cc:302] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
W20260807 13:39:11.527846 25692 log.cc:924] Time spent T b078a19f38494b04ad11b14d98ec4bca P 9ae273efd33642ad970ab8d1973917c1: Append to log took a long time: real 0.090s user 0.001s sys 0.000s
I20260807 13:39:11.528213 25619 leader_election.cc:288] T ea6c8df560094315891e2805f0b21791 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:11.529724 23577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49040 (request call id 541) took 1159 ms. Trace:
I20260807 13:39:11.530107 23577 rpcz_store.cc:276] 0807 13:39:10.370686 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:10.977675 (+606989us) service_pool.cc:227] Handling call
0807 13:39:11.012962 (+ 35287us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:11.042952 (+ 29990us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:11.042982 (+ 30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:11.093752 (+ 50770us) log.cc:842] Serialized 26 byte log entry
0807 13:39:11.313935 (+220183us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:39:11.313971 (+ 36us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:11.314037 (+ 66us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:11.529490 (+215453us) raft_consensus.cc:1671] finished
0807 13:39:11.529513 (+ 23us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:11.529657 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5274,"raft.queue_time_us":67261,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":26962,"thread_start_us":79868,"threads_started":1,"wal-append.queue_time_us":273760}
I20260807 13:39:11.433115 25372 consensus_queue.cc:1035] T 5164c8847c724b03bb6c8d0ba41d9535 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.088s
W20260807 13:39:11.533298 23668 consensus_meta.cc:287] T 2d4dd3ca60c94d7e891841088eb8f765 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.770s user 0.014s sys 0.001s
I20260807 13:39:11.534502 25628 raft_consensus.cc:2781] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:39:11.534970 25628 raft_consensus.cc:482] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:11.410380 23561 rpcz_store.cc:276] 0807 13:39:06.803857 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:06.806644 (+ 2787us) service_pool.cc:227] Handling call
0807 13:39:07.610237 (+803593us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:39:07.610405 (+ 168us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:39:09.599621 (+1989216us) tablet_metadata.cc:641] Metadata flushed
0807 13:39:11.000733 (+1401112us) tablet_replica.cc:205] Creating consensus instance
0807 13:39:11.365173 (+364440us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":112896}
I20260807 13:39:11.535849 25687 raft_consensus.cc:2726] T 5164c8847c724b03bb6c8d0ba41d9535 P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:39:11.523855 25326 raft_consensus.cc:2781] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:39:11.535447 25628 raft_consensus.cc:3037] T e6c49d31823d4cf4adca30ebd1b7eb7e P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:11.536494 25326 raft_consensus.cc:482] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:11.537081 25326 raft_consensus.cc:3037] T e6c49d31823d4cf4adca30ebd1b7eb7e P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:39:11.537138 25428 leader_election.cc:288] T d1bcab9bf8fc4a508a914326892a42a9 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
W20260807 13:39:11.538111 25165 consensus_meta.cc:287] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613: Time spent flushing consensus metadata: real 0.525s user 0.007s sys 0.003s
I20260807 13:39:11.538551 25165 raft_consensus.cc:504] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
W20260807 13:39:11.536541 23669 consensus_meta.cc:287] T f40430392f094845a0d657f677860f4d P 5e0ea5aa0c6d4846a5ccc9962342e17a: Time spent flushing consensus metadata: real 0.719s user 0.010s sys 0.001s
I20260807 13:39:11.540779 25377 raft_consensus.cc:2781] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:39:11.541198 25377 raft_consensus.cc:482] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:11.541633 25377 raft_consensus.cc:3037] T 98b1cb53677841e393a54d9204f8959e P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:39:11.517792 25655 raft_consensus.cc:2726] T 46e552e0aa3f4433858116fa31ee8458 P 9ae273efd33642ad970ab8d1973917c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:39:11.546592 23532 leader_election.cc:302] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:11.548650 25482 leader_election.cc:288] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:11.549521 23582 raft_consensus.cc:2379] T 05a3da79d3b0447cbc19c4f28279e134 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e11cad1eeaf5424c94e51241096f6613 in current term 3: Already voted for candidate 9ae273efd33642ad970ab8d1973917c1 in this term.
I20260807 13:39:11.535913 25345 raft_consensus.cc:482] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:39:11.552460 25681 log.cc:924] Time spent T 46e552e0aa3f4433858116fa31ee8458 P 5e0ea5aa0c6d4846a5ccc9962342e17a: Append to log took a long time: real 0.154s user 0.001s sys 0.000s
I20260807 13:39:11.555864 25165 leader_election.cc:288] T 173a6c34d23a480793ef93a33940fa0f P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:11.557266 25311 raft_consensus.cc:3037] T ea167f614ede4fb0b327431be74e98b0 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:11.569206 23430 leader_election.cc:302] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:11.573400 23430 leader_election.cc:302] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:11.567257 25345 raft_consensus.cc:504] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:11.571930 25165 raft_consensus.cc:2726] T 622dda6b9b914746953c43538b53bb7e P e11cad1eeaf5424c94e51241096f6613 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 13:39:11.576067 23480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 535) took 1345 ms. Trace:
I20260807 13:39:11.549672 25155 raft_consensus.cc:504] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:11.576696 25345 leader_election.cc:288] T 0e601359a84745c38ae821025d18d881 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:11.576483 23480 rpcz_store.cc:276] 0807 13:39:10.230637 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:11.354540 (+1123903us) service_pool.cc:227] Handling call
0807 13:39:11.354914 (+ 374us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:39:11.355175 (+ 261us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:11.355208 (+ 33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:39:11.355780 (+ 572us) log.cc:842] Serialized 26 byte log entry
0807 13:39:11.390178 (+ 34398us) raft_consensus.cc:1631] Marking committed up to 0
0807 13:39:11.390217 (+ 39us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:11.390281 (+ 64us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:39:11.575832 (+185551us) raft_consensus.cc:1671] finished
0807 13:39:11.575854 (+ 22us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:11.576006 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":33891,"threads_started":1,"wal-append.queue_time_us":187627}
I20260807 13:39:11.578647 25155 leader_election.cc:288] T 220c24fa0c52459182e1e89c74331f3b P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 3 election: Requested vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:11.584765 23532 leader_election.cc:302] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:11.585660 25345 raft_consensus.cc:2726] T a08c7e6c1b31456ea804d5ecdf2a5b70 P 9ae273efd33642ad970ab8d1973917c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:11.586642 23532 leader_election.cc:302] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, e11cad1eeaf5424c94e51241096f6613
I20260807 13:39:11.587529 25345 raft_consensus.cc:2726] T ad4a1bc9b3a24e2da54bcbdc8ae0b14c P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:39:11.590621 25165 raft_consensus.cc:2781] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:39:11.591452 25165 raft_consensus.cc:482] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e0ea5aa0c6d4846a5ccc9962342e17a)
I20260807 13:39:11.592165 25165 raft_consensus.cc:3037] T b078a19f38494b04ad11b14d98ec4bca P e11cad1eeaf5424c94e51241096f6613 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:39:11.601810 23430 leader_election.cc:302] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:11.604117 23430 leader_election.cc:302] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:11.605381 23430 leader_election.cc:302] T 4da43081a61b4d25bbd028722bd1223c P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:11.612407 25677 raft_consensus.cc:482] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:11.612888 25529 raft_consensus.cc:482] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:39:11.612754 25579 raft_consensus.cc:348] T 0d7a01108a7042148334c054995cba3b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } }
I20260807 13:39:11.613737 25579 raft_consensus.cc:374] T 0d7a01108a7042148334c054995cba3b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:39:11.613482 25529 raft_consensus.cc:504] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:11.614069 25579 raft_consensus.cc:729] T 0d7a01108a7042148334c054995cba3b P 9ae273efd33642ad970ab8d1973917c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ae273efd33642ad970ab8d1973917c1, State: Initialized, Role: FOLLOWER
I20260807 13:39:11.595598 25565 raft_consensus.cc:504] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:11.616279 25529 leader_election.cc:288] T 0e601359a84745c38ae821025d18d881 P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
I20260807 13:39:11.617048 25526 raft_consensus.cc:2781] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:39:11.617304 25565 leader_election.cc:288] T a42b974d289d402ea12744b7caf94ae8 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 election: Requested vote from peers 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363), 5e0ea5aa0c6d4846a5ccc9962342e17a (127.21.69.3:36765)
I20260807 13:39:11.617588 25526 raft_consensus.cc:686] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [term 5 LEADER]: Becoming Leader. State: Replica: e11cad1eeaf5424c94e51241096f6613, State: Running, Role: LEADER
I20260807 13:39:11.618024 25306 raft_consensus.cc:3037] T ce381b59fcae417a87681d73e12ca9ea P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:39:11.613099 25677 raft_consensus.cc:504] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } } peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } }
I20260807 13:39:11.618721 25526 consensus_queue.cc:237] T c8a377464d3c4243989dd0c5f15cd3f1 P e11cad1eeaf5424c94e51241096f6613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ae273efd33642ad970ab8d1973917c1" member_type: VOTER last_known_addr { host: "127.21.69.2" port: 33363 } } peers { permanent_uuid: "5e0ea5aa0c6d4846a5ccc9962342e17a" member_type: VOTER last_known_addr { host: "127.21.69.3" port: 36765 } } peers { permanent_uuid: "e11cad1eeaf5424c94e51241096f6613" member_type: VOTER last_known_addr { host: "127.21.69.1" port: 45037 } }
@ 0x7fc691a3cc87 __libc_start_main at ??:0
I20260807 13:39:11.621819 25677 leader_election.cc:288] T ae09b72e43be4ee7a4c56900f3f31fdb P 5e0ea5aa0c6d4846a5ccc9962342e17a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e11cad1eeaf5424c94e51241096f6613 (127.21.69.1:45037), 9ae273efd33642ad970ab8d1973917c1 (127.21.69.2:33363)
@ 0x294389 (unknown) at ??:?
W20260807 13:39:11.622556 23533 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.69.3:36765, user_credentials={real_user=slave}} blocked reactor thread for 107929us
I20260807 13:39:11.629171 23430 leader_election.cc:302] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
W20260807 13:39:11.604300 23559 consensus_meta.cc:287] T 19ee3f9a953c4bbd889fc7001a63fec1 P 9ae273efd33642ad970ab8d1973917c1: Time spent flushing consensus metadata: real 0.746s user 0.012s sys 0.001s
I20260807 13:39:11.630880 23430 leader_election.cc:302] T 6b23b4f74b0f41e1920fa0a5b83ed1a1 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ae273efd33642ad970ab8d1973917c1, e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a
I20260807 13:39:11.614895 25689 raft_consensus.cc:482] T 608f7e63bc4648e0890e5f601c52736c P 5e0ea5aa0c6d4846a5ccc9962342e17a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9ae273efd33642ad970ab8d1973917c1)
I20260807 13:39:11.622566 25482 raft_consensus.cc:2781] T 98b1cb53677841e393a54d9204f8959e P 9ae273efd33642ad970ab8d1973917c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:39:11.641029 23677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57116 (request call id 670) took 2046 ms. Trace:
I20260807 13:39:11.641429 23430 leader_election.cc:302] T fcdef01e85a44e1093dd335055986423 P e11cad1eeaf5424c94e51241096f6613 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e11cad1eeaf5424c94e51241096f6613; no voters: 5e0ea5aa0c6d4846a5ccc9962342e17a, 9ae273efd33642ad970ab8d1973917c1
I20260807 13:39:11.642378 23469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33986 (request call id 536) took 1212 ms. Trace:
I20260807 13:39:11.641412 23677 rpcz_store.cc:276] 0807 13:39:09.594855 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:39:09.731328 (+136473us) service_pool.cc:227] Handling call
0807 13:39:09.770778 (+ 39450us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:39:10.464682 (+693904us) spinlock_profiling.cc:243] Waited 76.4 ms on lock 0x7b54003ebaa0. stack: 00007fc695105033 00007fc695104f30 00007fc694a63534 00007fc69e76f8b4 00007fc69e76f849 00007fc697fe4471 00007fc697fef730 00007fc698061300 00007fc698062371 00007fc69805eedf 00007fc69805e99e 00007fc69cfa02e9 00007fc696686684 00007fc696686612 00007fc696686541 00007fc6966864bc
0807 13:39:11.640633 (+1175951us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:39:11.640668 (+ 35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:39:11.640710 (+ 42us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:39:11.640741 (+ 31us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:39:11.640812 (+ 71us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:39:11.640964 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":275850,"spinlock_wait_cycles":175760256}
I20260807 13:39:11.634677 25556 raft_consensus.cc:3037] T 2d8b8a0a0e1f4c39b49a8113f26cb278 P e11cad1eeaf5424c94e51241096f6613 [term 3 FOLLOWER]: Advancing to term 4